00000001:02000400:3.0F:1789545472.904070:0:2967:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg116-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1789545489.991428:0:3188:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg116-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1789545491.541657:0:3247:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 775 MB/s 00000001:01000000:2.0F:1789545491.791975:0:3247:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 787 MB/s 00000001:01000000:3.0:1789545492.041463:0:3247:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 7611 MB/s 00000020:02000000:3.0:1789545492.475527:0:3280:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_g897064a 00000400:02000000:1.0F:1789545493.033557:0:3295:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.201.116@tcp [8/256/0/180] 00008000:02000000:3.0:1789545496.088143:0:3444:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1789545540.441354:0:5250:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg116-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789545549.566686:0:5827:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789545549.566691:0:5827:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1789545549.566843:0:5827:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000009913ad5b 00000080:02000400:0.0:1789545549.566854:0:5827:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1789545549.571910:0:5827:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1789545549.571923:0:5827:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789545549.572115:0:5827:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000108d3cf7) 00000020:00000080:2.0:1789545549.572136:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789545549.596265:0:5827:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1789545549.597438:0:5827:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1789545549.629990:0:5827:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1789545549.630029:0:5827:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789545549.630049:0:5827:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1789545549.631312:0:5827:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789545549.631348:0:5827:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1789545549.631870:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789545549.631879:0:5827:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789545549.631890:0:5827:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x64919c0f856c02cd 00000020:01000004:1.0:1789545549.631899:0:5827:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1789545549.631904:0:5827:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789545549.631908:0:5827:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009913ad5b from MGS 00000020:01000004:1.0:1789545549.631913:0:5827:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789545549.631931:0:5827:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000fa314e14) 00000020:00000080:1.0:1789545549.631943:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789545549.632046:0:5827:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009913ad5b from MGS, refs=2 00080000:01000000:1.0:1789545549.632051:0:5827:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789545549.632056:0:5827:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x64919c0f856c02db 00000100:00100000:1.0:1789545549.632975:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789545549.633182:0:5827:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789545549.633189:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789545549.633858:0:5827:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789545549.633865:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789545549.636211:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789545549.636605:0:5827:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789545549.636612:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789545549.637249:0:5827:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789545549.637259:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789545549.638121:0:5827:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789545549.638137:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789545549.641897:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545549.641903:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545549.641905:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545549.642353:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545549.642356:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545549.642708:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545549.643033:0:5827:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789545549.649495:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1789545549.893506:0:5827:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1992 MB/s 00000001:01000000:2.0:1789545550.144495:0:5827:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2227 MB/s 00000001:01000000:1.0:1789545550.399796:0:5827:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 431 MB/s 00000001:01000000:2.0:1789545550.650305:0:5827:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 487 MB/s 00010000:00010000:3.0:1789545550.652544:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1789545550.664932:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1789545550.685987:0:5827:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1789545550.686004:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789545550.686006:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1789545550.687209:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789545550.687312:0:5827:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789545550.687411:0:5827:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1789545550.687656:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789545550.687687:0:5827:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789545550.687998:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789545550.688168:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789545550.688174:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789545550.689270:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789545550.689280:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789545550.691740:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789545550.691754:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789545550.696512:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789545550.696541:0:5827:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.116@tcp' 00000020:01000004:1.0:1789545550.696543:0:5827:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789545550.696612:0:5827:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.116@tcp (typ=mgc) 00000020:00000080:1.0:1789545550.696626:0:5827:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.116@tcp (000000000caaf883) 00000020:00000080:1.0:1789545550.696643:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789545550.696735:0:5827:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e787e7d8@MGC192.168.201.116@tcp: add connection 192.168.201.116@tcp at head 00010000:00010000:1.0:1789545550.696976:0:5827:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.116@tcp-0 is initialized 00000040:01000000:1.0:1789545550.696984:0:5827:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.116@tcp ctxt 1 is initialized 00000100:00080000:3.0:1789545550.697804:0:5842:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1789545550.709534:0:5843:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789545550.710734:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.116@tcp (uuid beb86ab1-4563-44b1-afd1-f08a43b0622e) 00000020:00000080:3.0:1789545550.710763:0:5827:0:(genops.c:1384:class_connect()) connect: client beb86ab1-4563-44b1-afd1-f08a43b0622e, cookie 0x64919c0f856c02e9 00000100:00080000:3.0:1789545550.710778:0:5827:0:(import.c:545:import_select_connection()) MGC192.168.201.116@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789545550.710789:0:5827:0:(import.c:666:import_select_connection()) MGC192.168.201.116@tcp: import 00000000e787e7d8 using connection 192.168.201.116@tcp/0@lo 00000100:00100000:3.0:1789545550.710842:0:5827:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001e5b8530 x1876474454868096/t0(0) o250->MGC192.168.201.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789545550.710872:0:5827:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import beb86ab1-4563-44b1-afd1-f08a43b0622e->MGS 00000020:01000004:3.0:1789545550.713735:0:5827:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789545550.713748:0:5827:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789545550.713782:0:5827:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000002fe0b858) 00000020:00000080:3.0:1789545550.713802:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789545550.715278:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e5b8530 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:beb86ab1-4563-44b1-afd1-f08a43b0622e:3310:1876474454868096:0@lo:250: 00000100:00100000:2.0:1789545550.715409:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545550.725169:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454868096 00000100:00100000:0.0:1789545550.725189:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454868096 00000100:00100000:0.0:1789545550.725249:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789545550.725257:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dda77db5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1876474454868096:12345-0@lo:250: 00010000:00080000:0.0:1789545550.725287:0:5838:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from beb86ab1-4563-44b1-afd1-f08a43b0622e@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:0.0:1789545550.725317:0:5838:0:(genops.c:1384:class_connect()) connect: client beb86ab1-4563-44b1-afd1-f08a43b0622e, cookie 0x64919c0f856c02f7 00000100:00080000:0.0:1789545550.725484:0:5838:0:(import.c:65:import_set_state_nolock()) 0000000011c3ca96 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789545550.725597:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dda77db5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+5:3310:x1876474454868096:12345-0@lo:250: Request processed in 339us (10188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545550.725606:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789545550.725673:0:3310:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.116@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789545550.725682:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.116@tcp: connect to target with instance 0 00000100:00080000:0.0:1789545550.725690:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.116@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789545550.725694:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789545550.725696:0:3310:0:(import.c:65:import_set_state_nolock()) 00000000e787e7d8 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789545550.725699:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789545550.725707:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789545550.725712:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e5b8530 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:beb86ab1-4563-44b1-afd1-f08a43b0622e:3310:1876474454868096:0@lo:250: 00000100:00100000:3.0:1789545550.730921:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789545550.731159:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789545550.731166:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789545550.739918:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789545550.739934:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789545550.740976:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789545550.740984:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789545550.741859:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789545550.744533:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789545550.744545:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789545550.750660:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789545550.750809:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789545550.800329:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789545550.800814:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789545550.800822:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789545550.802288:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789545550.802302:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789545550.806811:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789545550.807025:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789545550.807032:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789545550.809954:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789545550.809975:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789545550.810907:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789545550.811099:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789545550.811105:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789545550.817945:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789545550.817974:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789545550.819247:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789545550.819633:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789545550.819641:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789545550.820124:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789545550.820129:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789545550.853034:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789545550.853324:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789545550.853332:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789545550.858305:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789545550.858321:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789545550.859314:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789545550.859325:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789545550.861724:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789545550.861750:0:5827:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1789545550.861756:0:5827:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.116@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789545550.861907:0:5827:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.116@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789545550.861947:0:5827:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.116@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1789545550.861952:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789545550.861954:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789545550.861955:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789545550.861957:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789545550.861958:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789545550.861959:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789545550.861960:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789545550.861962:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789545550.861963:0:5827:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789545550.861964:0:5827:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789545550.861965:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789545550.861967:0:5827:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789545550.861969:0:5827:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1789545550.861971:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789545550.861973:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789545550.861974:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789545550.861975:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789545550.861976:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789545550.861977:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789545550.861977:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789545550.861979:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789545550.861980:0:5827:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789545550.861981:0:5827:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789545550.861982:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789545550.861983:0:5827:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789545550.862020:0:5827:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789545550.862040:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018317c56 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454868224:0@lo:253: 00000100:00100000:1.0:1789545550.862122:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545550.862183:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000350be7be going to sleep for 11 seconds 00000100:00100000:2.0:1789545550.862943:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454868224 00000100:00100000:2.0:1789545550.862952:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454868224 00000100:00100000:2.0:1789545550.863001:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789545550.863010:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d0177dad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+5:5827:x1876474454868224:12345-0@lo:253: 20000000:01000000:2.0:1789545550.863060:0:5840:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789545550.863063:0:5840:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1789545550.863693:0:5862:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789545550.863767:0:5840:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1789545550.864110:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789545550.865063:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1789545550.865338:0:5840:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789545550.865342:0:5840:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1789545550.865348:0:5840:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1789545550.865351:0:5840:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1789545550.865410:0:5840:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1789545550.865634:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789545550.865883:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1789545550.865897:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789545550.865941:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1789545550.865983:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1789545550.866020:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1789545550.866120:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1789545550.866129:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1789545550.866186:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1789545550.866195:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1789545550.866227:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1789545550.866234:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1789545550.866263:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1789545550.866313:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1789545550.866345:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789545550.866350:0:5840:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1789545550.866393:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789545550.866622:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1789545550.866633:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789545550.866667:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1789545550.866701:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1789545550.866749:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1789545550.866760:0:5840:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1789545550.866834:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1789545550.866842:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789545550.866879:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1789545550.866910:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1789545550.866938:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1789545550.866947:0:5840:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1789545550.867033:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1789545550.867043:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1789545550.867077:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1789545550.867112:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1789545550.867264:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1789545550.867307:0:5840:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1789545550.867313:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1789545550.871003:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1789545550.878202:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1789545550.878237:0:5840:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.116@tcp for mdt 20000000:01000000:2.0:1789545550.878239:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.116@tcp (null) (null) (null) 00000040:00080000:2.0:1789545550.878265:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1789545550.878276:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789545550.878296:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1789545550.878300:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.116@tcp (null) (null) 00000040:00080000:2.0:1789545550.878324:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1789545550.878331:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1789545550.878347:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1789545550.878402:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1789545550.878478:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789545550.878482:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789545550.878486:0:5840:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789545550.878499:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789545550.878501:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789545550.878529:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789545550.878531:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789545550.883295:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1789545550.884415:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1789545550.884484:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1789545550.884558:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:3.0:1789545550.884573:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789545550.884576:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789545550.885103:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1789545550.885330:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1789545550.885401:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1789545550.885437:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1789545550.885450:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789545550.885453:0:5840:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1789545550.885473:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789545550.885475:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789545550.885481:0:5840:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1789545550.885489:0:5840:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789545550.890337:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1789545550.890518:0:5840:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1789545550.899626:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1789545550.899686:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1789545550.899763:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1789545550.899788:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789545550.899814:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000afcf9947/0x64919c0f856c02fe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545550.899834:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000afcf9947/0x64919c0f856c02fe lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545550.899847:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000afcf9947/0x64919c0f856c02fe lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545550.899853:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000afcf9947/0x64919c0f856c02fe lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545550.899860:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000afcf9947/0x64919c0f856c02fe lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545550.899883:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000afcf9947/0x64919c0f856c02fe lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545550.899889:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000afcf9947 already unused, calling callback (000000001ba914cd) 00010000:00010000:2.0:1789545550.899893:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000afcf9947/0x64919c0f856c02fe lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545550.899901:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000afcf9947/0x64919c0f856c02fe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545550.899913:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000afcf9947/0x64919c0f856c02fe lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545550.899920:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000afcf9947/0x64919c0f856c02fe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545550.899925:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000afcf9947/0x64919c0f856c02fe lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789545550.899944:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789545551.178413:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d0177dad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+5:5827:x1876474454868224:12345-0@lo:253: Request processed in 315395us (316283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545551.178434:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789545551.180066:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018317c56 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454868224:0@lo:253: 10000000:01000000:0.0:1789545551.180084:0:5827:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789545551.180086:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789545551.180088:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789545551.180089:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789545551.180090:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1789545551.180091:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789545551.180091:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789545551.180092:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789545551.180093:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789545551.180094:0:5827:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789545551.180095:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789545551.180096:0:5827:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789545551.180118:0:5827:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009913ad5b from lustre-MDT0000 10000000:01000000:0.0:1789545551.180145:0:5827:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789545551.180147:0:5827:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789545551.180152:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff994bc65dcd40 10000000:01000000:0.0:1789545551.180157:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789545551.180166:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff994bc65dcd40 from 1 10000000:01000000:0.0:1789545551.180168:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789545551.180223:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: 00000000f8b679b1/0x64919c0f856c0305 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.180238:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: 00000000f8b679b1/0x64919c0f856c0305 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.180245:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: 00000000f8b679b1/0x64919c0f856c0305 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545551.180260:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000069995150 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454868352:0@lo:101: 00000100:00100000:0.0:1789545551.180546:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545551.180687:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 0000000031ce401f going to sleep for 11 seconds 00000100:00100000:1.0:1789545551.180826:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454868352 00000100:00100000:1.0:1789545551.180835:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454868352 00000100:00100000:1.0:1789545551.181070:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789545551.181080:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000056615cf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+5:5827:x1876474454868352:12345-0@lo:101: 00010000:00010000:1.0:1789545551.181093:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545551.181127:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000000361db3/0x64919c0f856c030c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c0305 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545551.181149:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000000361db3/0x64919c0f856c030c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c0305 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545551.181159:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000000361db3/0x64919c0f856c030c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0305 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545551.181180:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000000361db3, rc 0) 00000100:00100000:1.0:1789545551.181243:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000056615cf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+6:5827:x1876474454868352:12345-0@lo:101: Request processed in 166us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545551.181250:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789545551.181327:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000069995150 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454868352:0@lo:101: 00010000:00010000:2.0:1789545551.181341:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: 00000000f8b679b1/0x64919c0f856c0305 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c030c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545551.181348:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: 00000000f8b679b1/0x64919c0f856c0305 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c030c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545551.181425:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002e83937f pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454868480:0@lo:501: 00000100:00100000:2.0:1789545551.181461:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545551.181648:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 0000000025a0e2cd going to sleep for 11 seconds 00000100:00100000:0.0:1789545551.182007:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454868480 00000100:00100000:0.0:1789545551.182013:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454868480 00000100:00100000:0.0:1789545551.182037:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789545551.182044:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000084e0a167 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+6:5827:x1876474454868480:12345-0@lo:501: 00000100:00100000:1.0:1789545551.187464:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000084e0a167 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+6:5827:x1876474454868480:12345-0@lo:501: Request processed in 5400us (5982us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789545551.187481:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789545551.187522:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002e83937f pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454868480:0@lo:501: 10000000:01000000:2.0:1789545551.187561:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789545551.187583:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: 00000000f8b679b1/0x64919c0f856c0305 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c030c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545551.187593:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: 00000000f8b679b1/0x64919c0f856c0305 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c030c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789545551.187604:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff994bc4a49800 10000000:01000000:2.0:1789545551.187610:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789545551.187615:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff994bc4a49800 10000000:01000000:2.0:1789545551.187618:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789545551.187621:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff994bc4a49800 from 1 10000000:01000000:2.0:1789545551.187623:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789545551.187804:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: 00000000afcf9947/0x64919c0f856c0313 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545551.187813:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: 00000000afcf9947/0x64919c0f856c0313 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545551.187823:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: 00000000afcf9947/0x64919c0f856c0313 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545551.187841:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002e83937f pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454868608:0@lo:101: 00000100:00100000:2.0:1789545551.187876:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545551.188039:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 0000000025a0e2cd going to sleep for 11 seconds 00000100:00100000:1.0:1789545551.190064:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454868608 00000100:00100000:1.0:1789545551.190080:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454868608 00000100:00100000:1.0:1789545551.190257:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789545551.190267:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fbba9311 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+6:5827:x1876474454868608:12345-0@lo:101: 00010000:00010000:1.0:1789545551.190283:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545551.190312:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a167b4de/0x64919c0f856c031a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c0313 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545551.190341:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a167b4de/0x64919c0f856c031a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c0313 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545551.190352:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a167b4de/0x64919c0f856c031a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0313 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545551.190376:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a167b4de, rc 0) 00000100:00100000:1.0:1789545551.190465:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fbba9311 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+7:5827:x1876474454868608:12345-0@lo:101: Request processed in 200us (2589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545551.190473:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789545551.190567:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002e83937f pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454868608:0@lo:101: 00010000:00010000:2.0:1789545551.190585:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: 00000000afcf9947/0x64919c0f856c0313 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c031a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545551.190607:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: 00000000afcf9947/0x64919c0f856c0313 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c031a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789545551.190626:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789545551.190630:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: 00000000afcf9947/0x64919c0f856c0313 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c031a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545551.190648:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: 00000000afcf9947/0x64919c0f856c0313 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c031a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789545551.190655:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789545551.190660:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789545551.190665:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff994bc4a49800 10000000:01000000:2.0:1789545551.190667:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789545551.190671:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789545551.190673:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789545551.190704:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: 000000007c57c002/0x64919c0f856c0321 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545551.190711:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: 000000007c57c002/0x64919c0f856c0321 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545551.190718:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: 000000007c57c002/0x64919c0f856c0321 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545551.190737:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002e83937f pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454868736:0@lo:101: 00000100:00100000:2.0:1789545551.190771:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545551.191067:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 0000000025a0e2cd going to sleep for 11 seconds 00000100:00100000:0.0:1789545551.191170:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454868736 00000100:00100000:0.0:1789545551.191177:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454868736 00000100:00100000:0.0:1789545551.191201:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789545551.191206:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000338fe660 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+7:5827:x1876474454868736:12345-0@lo:101: 00010000:00010000:0.0:1789545551.191214:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545551.191226:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007d590cfc/0x64919c0f856c0328 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c0321 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.191240:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007d590cfc/0x64919c0f856c0328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c0321 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.191248:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007d590cfc/0x64919c0f856c0328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0321 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.191254:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007d590cfc, rc 0) 00000100:00100000:0.0:1789545551.191510:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000338fe660 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+8:5827:x1876474454868736:12345-0@lo:101: Request processed in 303us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545551.191517:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789545551.193599:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002e83937f pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454868736:0@lo:101: 00010000:00010000:2.0:1789545551.193629:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: 000000007c57c002/0x64919c0f856c0321 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0328 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545551.193751:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: 000000007c57c002/0x64919c0f856c0321 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c0328 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545551.193983:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098213e06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454868864:0@lo:501: 00000100:00100000:3.0:1789545551.194066:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545551.194116:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000048a1af7 going to sleep for 11 seconds 00000100:00100000:1.0:1789545551.194717:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454868864 00000100:00100000:1.0:1789545551.194726:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454868864 00000100:00100000:1.0:1789545551.194797:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789545551.194805:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004217cfa8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+8:5827:x1876474454868864:12345-0@lo:501: 00000100:00100000:1.0:1789545551.195092:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004217cfa8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+9:5827:x1876474454868864:12345-0@lo:501: Request processed in 288us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545551.195098:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789545551.195140:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000098213e06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454868864:0@lo:501: 00000100:00100000:3.0:1789545551.195179:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098213e06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454868992:0@lo:503: 00000100:00100000:3.0:1789545551.195218:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545551.195248:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000048a1af7 going to sleep for 11 seconds 00000100:00100000:1.0:1789545551.195279:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454868992 00000100:00100000:1.0:1789545551.195285:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454868992 00000100:00100000:1.0:1789545551.195313:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789545551.195318:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eef46186 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+9:5827:x1876474454868992:12345-0@lo:503: 00000100:00100000:1.0:1789545551.195502:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eef46186 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+9:5827:x1876474454868992:12345-0@lo:503: Request processed in 185us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545551.195507:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789545551.195706:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000098213e06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454868992:0@lo:503: 00000100:00100000:3.0:1789545551.196920:0:5869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098213e06 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:5869:1876474454869120:0@lo:502: 00000100:00100000:3.0:1789545551.196981:0:5869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545551.197021:0:5869:0:(client.c:2716:ptlrpc_set_wait()) set 00000000735b0364 going to sleep for 11 seconds 00000100:00100000:1.0:1789545551.197029:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454869120 00000100:00100000:1.0:1789545551.197037:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454869120 00000100:00100000:1.0:1789545551.197077:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789545551.197084:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000010950d16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+9:5869:x1876474454869120:12345-0@lo:502: 00000100:00100000:1.0:1789545551.197298:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000010950d16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+9:5869:x1876474454869120:12345-0@lo:502: Request processed in 207us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545551.197306:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789545551.197482:0:5869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000098213e06 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:5869:1876474454869120:0@lo:502: 00000020:01000000:3.0:1789545551.197505:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789545551.197517:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789545551.197519:0:5869:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789545551.197523:0:5869:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789545551.197526:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789545551.197538:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000001cbd2a74) 00000020:00000080:3.0:1789545551.197570:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789545551.197575:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789545551.197634:0:5869:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789545551.197639:0:5869:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x64919c0f856c0336 00000020:00000080:3.0:1789545551.197826:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789545551.197829:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789545551.197832:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789545551.197833:0:5869:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789545551.197835:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789545551.197838:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789545551.197839:0:5869:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789545551.197842:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789545551.197847:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000af1bcb19) 00000020:00000080:3.0:1789545551.197854:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789545551.197857:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789545551.197859:0:5869:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789545551.197861:0:5869:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789545551.197866:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789545551.197899:0:5869:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009913ad5b from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789545551.197909:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000f63fa08f) 00000020:00000080:3.0:1789545551.197917:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789545551.197975:0:5869:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789545551.197979:0:5869:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x64919c0f856c034b 00000020:00000080:3.0:1789545551.198075:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789545551.198080:0:5869:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789545551.198084:0:5869:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x64919c0f856c0352 00080000:01000000:3.0:1789545551.198088:0:5869:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789545551.198091:0:5869:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x64919c0f856c0359 00080000:10000000:3.0:1789545551.198512:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1789545551.198683:0:5869:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1789545551.203535:0:5869:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1789545551.284730:0:5869:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1789545551.285149:0:5869:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1789545551.287386:0:5869:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789545551.287680:0:5869:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789545551.308296:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000c7420dd7) 00000020:00000080:3.0:1789545551.308320:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789545551.308432:0:5869:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789545551.308439:0:5869:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x64919c0f856c0367 00000020:00000080:1.0:1789545551.310389:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1789545551.311794:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789545551.350178:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789545551.386756:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789545551.411112:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789545551.455504:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789545551.480722:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1789545551.511129:0:5869:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x64919c0f856c036e 00000020:00000080:2.0:1789545551.511589:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789545551.511600:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789545551.511607:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545551.511609:0:5869:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789545551.511613:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789545551.511618:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545551.511620:0:5869:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789545551.511623:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789545551.511624:0:5869:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789545551.511627:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789545551.511629:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545551.511630:0:5869:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789545551.511632:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789545551.511637:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545551.511638:0:5869:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789545551.511642:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789545551.511680:0:5869:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1789545551.511735:0:5869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002e83937f pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:5869:1876474454869248:0@lo:502: 00000100:00100000:2.0:1789545551.511810:0:5869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545551.511892:0:5869:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c1c6644 going to sleep for 11 seconds 00000100:00100000:0.0:1789545551.512115:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454869248 00000100:00100000:0.0:1789545551.512123:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454869248 00000100:00100000:0.0:1789545551.512204:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789545551.512213:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a0b08629 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+9:5869:x1876474454869248:12345-0@lo:502: 00000100:00100000:0.0:1789545551.512761:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a0b08629 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+9:5869:x1876474454869248:12345-0@lo:502: Request processed in 549us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545551.512771:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789545551.512985:0:5869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002e83937f pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:5869:1876474454869248:0@lo:502: 00000020:01000000:2.0:1789545551.513016:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789545551.513037:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545551.513039:0:5869:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1789545551.513043:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1789545551.513388:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1789545551.513406:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789545551.513426:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: 000000007c57c002/0x64919c0f856c0321 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0328 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.513437:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: 000000007c57c002/0x64919c0f856c0321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0328 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789545551.513455:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff994bc4a49800 from 1 10000000:01000000:0.0:1789545551.513458:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789545551.513485:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: 00000000e5820da2/0x64919c0f856c0375 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.513493:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: 00000000e5820da2/0x64919c0f856c0375 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.513502:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: 00000000e5820da2/0x64919c0f856c0375 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545551.513518:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000026c1c628 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454869376:0@lo:101: 00000100:00100000:0.0:1789545551.513561:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545551.513594:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000359eedfb going to sleep for 11 seconds 00000100:00100000:2.0:1789545551.513708:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454869376 00000100:00100000:2.0:1789545551.513714:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454869376 00000100:00100000:0.0:1789545551.513862:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789545551.513870:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009a80ed50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+9:5827:x1876474454869376:12345-0@lo:101: 00010000:00010000:0.0:1789545551.513881:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545551.513894:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d0f9331e/0x64919c0f856c037c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c0375 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.513914:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d0f9331e/0x64919c0f856c037c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c0375 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.513924:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d0f9331e/0x64919c0f856c037c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0375 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.513931:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d0f9331e, rc 0) 00000100:00100000:0.0:1789545551.513972:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009a80ed50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+10:5827:x1876474454869376:12345-0@lo:101: Request processed in 103us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545551.513978:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789545551.514041:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000026c1c628 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454869376:0@lo:101: 00010000:00010000:2.0:1789545551.514053:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: 00000000e5820da2/0x64919c0f856c0375 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c037c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545551.514061:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: 00000000e5820da2/0x64919c0f856c0375 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c037c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545551.514591:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002e83937f pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454869504:0@lo:256: 00000100:00100000:2.0:1789545551.514630:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545551.514869:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c1c6644 going to sleep for 11 seconds 00000100:00100000:3.0:1789545551.514900:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454869504 00000100:00100000:3.0:1789545551.514905:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454869504 00000100:00100000:3.0:1789545551.514931:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789545551.514937:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e1fef995 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+10:5827:x1876474454869504:12345-0@lo:256: 20000000:01000000:3.0:1789545551.514952:0:5840:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789545551.514957:0:5840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789545551.515187:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e1fef995 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+10:5827:x1876474454869504:12345-0@lo:256: Request processed in 249us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545551.515194:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789545551.515289:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002e83937f pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454869504:0@lo:256: 10000000:01000000:2.0:1789545551.516013:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789545551.516129:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: 00000000e5820da2/0x64919c0f856c0375 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c037c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545551.516141:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: 00000000e5820da2/0x64919c0f856c0375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c037c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789545551.516149:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994bc4a49800 from 1 10000000:01000000:2.0:1789545551.516152:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789545551.516179:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: 00000000cba457a8/0x64919c0f856c0383 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545551.516186:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: 00000000cba457a8/0x64919c0f856c0383 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545551.516204:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: 00000000cba457a8/0x64919c0f856c0383 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545551.516223:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002e83937f pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454869632:0@lo:101: 00000100:00100000:2.0:1789545551.516263:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545551.516300:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c1c6644 going to sleep for 11 seconds 00000100:00100000:0.0:1789545551.516384:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454869632 00000100:00100000:0.0:1789545551.516391:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454869632 00000100:00100000:0.0:1789545551.516429:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789545551.516437:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001ad8ab85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+10:5827:x1876474454869632:12345-0@lo:101: 00010000:00010000:0.0:1789545551.516850:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545551.516865:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009c0d37c5/0x64919c0f856c038a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c0383 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.516887:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009c0d37c5/0x64919c0f856c038a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c0383 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.516908:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009c0d37c5/0x64919c0f856c038a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0383 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.516917:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009c0d37c5, rc 0) 00000100:00100000:0.0:1789545551.516962:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001ad8ab85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+11:5827:x1876474454869632:12345-0@lo:101: Request processed in 527us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545551.517147:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002e83937f pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454869632:0@lo:101: 00010000:00010000:2.0:1789545551.517160:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: 00000000cba457a8/0x64919c0f856c0383 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c038a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545551.517169:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: 00000000cba457a8/0x64919c0f856c0383 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c038a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545551.517224:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002e83937f pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454869760:0@lo:501: 00000100:00100000:2.0:1789545551.517250:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545551.517272:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c1c6644 going to sleep for 11 seconds 00000100:00100000:0.0:1789545551.517312:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789545551.517338:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454869760 00000100:00100000:0.0:1789545551.517342:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454869760 00000100:00100000:0.0:1789545551.517390:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789545551.517397:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c003e37c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+11:5827:x1876474454869760:12345-0@lo:501: 00000100:00100000:0.0:1789545551.518483:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c003e37c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+11:5827:x1876474454869760:12345-0@lo:501: Request processed in 1084us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545551.518493:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789545551.518639:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002e83937f pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454869760:0@lo:501: 00000100:00100000:2.0:1789545551.518678:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002e83937f pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454869888:0@lo:503: 00000100:00100000:2.0:1789545551.518719:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545551.518859:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c1c6644 going to sleep for 11 seconds 00000100:00100000:3.0:1789545551.518892:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454869888 00000100:00100000:3.0:1789545551.518900:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454869888 00000100:00100000:3.0:1789545551.518966:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789545551.518982:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000036d747ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+11:5827:x1876474454869888:12345-0@lo:503: 00000040:00080000:3.0:1789545551.519021:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789545551.519181:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000036d747ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+11:5827:x1876474454869888:12345-0@lo:503: Request processed in 200us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545551.519189:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789545551.519253:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002e83937f pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454869888:0@lo:503: 00000040:00080000:2.0:1789545551.520298:0:5873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1789545551.520481:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789545551.520499:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789545551.520519:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: 00000000cba457a8/0x64919c0f856c0383 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c038a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545551.520544:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: 00000000cba457a8/0x64919c0f856c0383 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c038a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789545551.520585:0:5827:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789545551.520588:0:5827:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff994bc4a49800 10000000:01000000:1.0:1789545551.520591:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff994bc4a49800 10000000:01000000:1.0:1789545551.520595:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789545551.520600:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff994bc4a49800 from 1 10000000:01000000:1.0:1789545551.520603:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789545551.520632:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: 000000009ba48638/0x64919c0f856c0391 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545551.520640:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: 000000009ba48638/0x64919c0f856c0391 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545551.520648:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: 000000009ba48638/0x64919c0f856c0391 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545551.520666:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc37052c pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454870016:0@lo:101: 00000100:00100000:1.0:1789545551.520714:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545551.521231:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000325a4c7d going to sleep for 11 seconds 00000100:00100000:0.0:1789545551.521297:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454870016 00000100:00100000:0.0:1789545551.521311:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454870016 00000100:00100000:0.0:1789545551.521345:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789545551.521352:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007f4cddce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+11:5827:x1876474454870016:12345-0@lo:101: 00010000:00010000:0.0:1789545551.521576:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545551.521589:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e749ae9a/0x64919c0f856c0398 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c0391 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.521611:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e749ae9a/0x64919c0f856c0398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c0391 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.521621:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e749ae9a/0x64919c0f856c0398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0391 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.521642:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e749ae9a, rc 0) 00000100:00100000:0.0:1789545551.521684:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007f4cddce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:5827:x1876474454870016:12345-0@lo:101: Request processed in 333us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545551.521691:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789545551.521779:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc37052c pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454870016:0@lo:101: 00010000:00010000:1.0:1789545551.521792:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: 000000009ba48638/0x64919c0f856c0391 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0398 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545551.521800:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: 000000009ba48638/0x64919c0f856c0391 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c0398 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545551.521857:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc37052c pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454870144:0@lo:501: 00000100:00100000:1.0:1789545551.521885:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545551.521913:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000325a4c7d going to sleep for 11 seconds 00000100:00100000:0.0:1789545551.522205:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454870144 00000100:00100000:0.0:1789545551.522210:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454870144 00000100:00100000:0.0:1789545551.522240:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789545551.522246:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000048f01af0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:5827:x1876474454870144:12345-0@lo:501: 00000100:00100000:0.0:1789545551.522659:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000048f01af0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:5827:x1876474454870144:12345-0@lo:501: Request processed in 412us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545551.522666:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789545551.522876:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc37052c pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454870144:0@lo:501: 00000100:00100000:2.0:1789545551.522913:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002e83937f pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454870272:0@lo:503: 00000100:00100000:2.0:1789545551.522958:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545551.523319:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 000000003f67318d going to sleep for 11 seconds 00000100:00100000:0.0:1789545551.523490:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454870272 00000100:00100000:0.0:1789545551.523496:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454870272 00000100:00100000:0.0:1789545551.523523:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789545551.523529:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000461396ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:5827:x1876474454870272:12345-0@lo:503: 00000100:00100000:0.0:1789545551.523868:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000461396ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:5827:x1876474454870272:12345-0@lo:503: Request processed in 339us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545551.523876:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789545551.524088:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002e83937f pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454870272:0@lo:503: 00000100:00100000:0.0:1789545551.529259:0:5874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc720f4b pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:5874:1876474454870400:0@lo:502: 00000100:00100000:0.0:1789545551.529515:0:5874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545551.531320:0:5874:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a0f034fa going to sleep for 11 seconds 00000100:00100000:3.0:1789545551.531422:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454870400 00000100:00100000:3.0:1789545551.531432:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454870400 00000100:00100000:3.0:1789545551.531496:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789545551.531518:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b560f2a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:5874:x1876474454870400:12345-0@lo:502: 00000100:00100000:3.0:1789545551.531953:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b560f2a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:5874:x1876474454870400:12345-0@lo:502: Request processed in 436us (2439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545551.531961:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789545551.532085:0:5874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc720f4b pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:5874:1876474454870400:0@lo:502: 00000020:01000004:0.0:1789545551.532153:0:5874:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789545551.532178:0:5874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000002f861bae) 00000020:00000080:0.0:1789545551.532197:0:5874:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1789545551.532625:0:5874:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009913ad5b from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789545551.532631:0:5874:0:(tgt_mount.c:187:server_put_mount()) put mount 000000009913ad5b from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789545551.532633:0:5874:0:(obd_mount.c:710:lustre_put_lsi()) put 000000009913ad5b 4 00010000:00080000:0.0:1789545551.532661:0:5874:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d1a17f3d@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.116@tcp at head 00010000:00010000:0.0:1789545551.537251:0:5874:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1789545551.537502:0:5874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789545551.537543:0:5874:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789545551.537557:0:5874:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x64919c0f856c03a6 00000100:00080000:0.0:1789545551.537566:0:5874:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789545551.537576:0:5874:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000d1a17f3d using connection 192.168.201.116@tcp/0@lo 00000100:00100000:0.0:1789545551.537611:0:5874:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000dc720f4b x1876474454870528/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789545551.537638:0:5874:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789545551.538145:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc720f4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876474454870528:0@lo:38: 00000100:00100000:3.0:1789545551.538220:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545551.540312:0:5874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000484e5ffb pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:5874:1876474454870656:0@lo:502: 00000100:00100000:0.0:1789545551.540413:0:5874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545551.540455:0:5874:0:(client.c:2716:ptlrpc_set_wait()) set 00000000028c844e going to sleep for 11 seconds 00000100:00100000:1.0:1789545551.540593:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454870528 00000100:00100000:1.0:1789545551.540600:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454870528 00000100:00100000:1.0:1789545551.540629:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789545551.540635:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000098213e06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1876474454870528:12345-0@lo:38: 00000100:00100000:1.0:1789545551.540689:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000098213e06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1876474454870528:12345-0@lo:38: Request processed in 53us (2470us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789545551.540695:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789545551.540732:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789545551.540739:0:3310:0:(import.c:65:import_set_state_nolock()) 00000000d1a17f3d lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789545551.540742:0:3310:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789545551.540745:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc720f4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876474454870528:0@lo:38: 00000100:00100000:1.0:1789545551.540776:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454870656 00000100:00100000:1.0:1789545551.540779:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454870656 00000100:00100000:1.0:1789545551.540801:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789545551.540806:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006dfbe022 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:5874:x1876474454870656:12345-0@lo:502: 00000100:00100000:1.0:1789545551.540996:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006dfbe022 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:5874:x1876474454870656:12345-0@lo:502: Request processed in 189us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545551.541002:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789545551.541187:0:5874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000484e5ffb pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:5874:1876474454870656:0@lo:502: 00000040:00080000:1.0:1789545551.541206:0:5874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1789545551.541886:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1789545551.541908:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789545551.541928:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: 000000009ba48638/0x64919c0f856c0391 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0398 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545551.541939:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: 000000009ba48638/0x64919c0f856c0391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0398 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789545551.542091:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789545551.542094:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789545551.542096:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789545551.542097:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789545551.542098:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789545551.542100:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789545551.542101:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789545551.542103:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789545551.542104:0:5827:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789545551.542105:0:5827:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789545551.542106:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789545551.542108:0:5827:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789545551.542111:0:5827:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1789545551.542114:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789545551.542115:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789545551.542116:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789545551.542117:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789545551.542118:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789545551.542119:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789545551.542120:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789545551.542121:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789545551.542122:0:5827:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789545551.542123:0:5827:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789545551.542124:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789545551.542128:0:5827:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789545551.542145:0:5827:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789545551.542155:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002e83937f pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454870784:0@lo:253: 00000100:00100000:2.0:1789545551.542194:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545551.542220:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c1c6644 going to sleep for 11 seconds 00000100:00100000:3.0:1789545551.542353:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454870784 00000100:00100000:3.0:1789545551.542378:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454870784 00000100:00100000:3.0:1789545551.542412:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789545551.542419:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000aca124df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:5827:x1876474454870784:12345-0@lo:253: 20000000:01000000:3.0:1789545551.542440:0:5840:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789545551.542464:0:5840:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789545551.587173:0:5840:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789545551.587192:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789545551.587499:0:5862:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789545551.587503:0:5862:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789545551.587522:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000098fdea96/0x64919c0f856c03ad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545551.587541:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d0f9331e/0x64919c0f856c037c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0375 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545551.587550:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000098fdea96/0x64919c0f856c03ad lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545551.587589:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d0f9331e/0x64919c0f856c037c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c0375 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545551.587603:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d0f9331e/0x64919c0f856c037c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c0375 expref: 12 pid: 5838 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545551.587616:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000055beef05 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5862:1876474454870912:0@lo:104: 00000100:00100000:2.0:1789545551.587677:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545551.587740:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set 00000000811b22de going to sleep for 11 seconds 00000100:00100000:0.0:1789545551.588013:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454870912 00000100:00100000:0.0:1789545551.588032:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454870912 00000100:00100000:0.0:1789545551.588079:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789545551.588088:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009ac401d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+3:5862:x1876474454870912:12345-0@lo:104: 00010000:00010000:0.0:1789545551.588100:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: 00000000e5820da2/0x64919c0f856c0375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c037c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.588155:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789545551.588160:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009ac401d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+3:5862:x1876474454870912:12345-0@lo:104: Request processed in 74us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545551.588167:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789545551.588187:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789545551.588216:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: 00000000e5820da2/0x64919c0f856c0375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c037c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.588223:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e5820da2 already unused, calling callback (00000000ba87aa7f) 10000000:00010000:0.0:1789545551.588226:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: 00000000e5820da2/0x64919c0f856c0375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c037c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.588234:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: 00000000e5820da2/0x64919c0f856c0375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c037c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789545551.588241:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: 00000000e5820da2/0x64919c0f856c0375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c037c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789545551.588246:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789545551.588272:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: 00000000e5820da2/0x64919c0f856c0375 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c037c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.588278:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789545551.588294:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: 00000000e5820da2/0x64919c0f856c0375 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c037c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.588312:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: 00000000e5820da2/0x64919c0f856c0375 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c037c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.588328:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545551.588330:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545551.588331:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545551.588455:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f0c2afa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454871040:0@lo:103: 00000100:00100000:0.0:1789545551.588483:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545551.588541:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454871040 00000100:00100000:0.0:1789545551.588547:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454871040 00010000:00010000:0.0:1789545551.588568:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d0f9331e/0x64919c0f856c037c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c0375 expref: 13 pid: 5838 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545551.588588:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789545551.588594:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000271360e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:3312:x1876474454871040:12345-0@lo:103: 00010000:00010000:0.0:1789545551.588603:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789545551.588607:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d0f9331e/0x64919c0f856c037c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c0375 expref: 13 pid: 5838 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.588616:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d0f9331e/0x64919c0f856c037c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c0375 expref: 13 pid: 5838 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.588631:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000098fdea96/0x64919c0f856c03ad lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.588638:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000098fdea96/0x64919c0f856c03ad lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789545551.588651:0:5831:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001148358s 00010000:00010000:0.0:1789545551.588654:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000098fdea96/0x64919c0f856c03ad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.588660:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000098fdea96/0x64919c0f856c03ad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.588666:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000098fdea96/0x64919c0f856c03ad lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.588672:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000098fdea96/0x64919c0f856c03ad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.588677:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000098fdea96 already unused, calling callback (000000001ba914cd) 00010000:00010000:0.0:1789545551.588686:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000098fdea96/0x64919c0f856c03ad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.588693:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000098fdea96/0x64919c0f856c03ad lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.588701:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000098fdea96/0x64919c0f856c03ad lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545551.588711:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789545551.588739:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000271360e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:3312:x1876474454871040:12345-0@lo:103: Request processed in 145us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545551.588746:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789545551.589387:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f0c2afa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454871040:0@lo:103: 00010000:00010000:2.0:1789545551.589559:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d0f9331e/0x64919c0f856c037c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c0375 expref: 12 pid: 5838 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545551.589573:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000055beef05 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5862:1876474454870912:0@lo:104: 00010000:00010000:2.0:1789545551.589587:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000098fdea96/0x64919c0f856c03ad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545551.589606:0:5862:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000098fdea96/0x64919c0f856c03ad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545551.589611:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000098fdea96/0x64919c0f856c03ad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545551.589615:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000098fdea96/0x64919c0f856c03ad lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545551.598834:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000aca124df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+11:5827:x1876474454870784:12345-0@lo:253: Request processed in 56338us (56562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545551.598850:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789545551.599019:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002e83937f pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:5827:1876474454870784:0@lo:253: 10000000:01000000:3.0:1789545551.599044:0:5827:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789545551.599047:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789545551.599049:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789545551.599050:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789545551.599051:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789545551.599052:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789545551.599054:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789545551.599055:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789545551.599056:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789545551.599058:0:5827:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789545551.599059:0:5827:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789545551.599061:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789545551.599062:0:5827:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789545551.599075:0:5827:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789545551.605681:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1789545551.606538:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789545551.606954:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1789545551.607619:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789545551.608104:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1789545551.608393:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1789545551.609488:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1789545551.609663:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1789545551.610147:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1789545551.610491:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1789545551.610683:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1789545551.611125:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1789545551.659540:0:5827:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00010000:00010000:3.0:1789545551.677530:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789545551.712212:0:5827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1789545551.712628:0:5880:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:3.0:1789545551.716230:0:5879:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1789545551.716238:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1789545551.720859:0:5827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789545551.721217:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789545551.721767:0:5827:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789545551.721776:0:5827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789545551.721937:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789545551.723726:0:5827:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789545551.724574:0:5827:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789545551.724614:0:5827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789545551.725157:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789545551.725618:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1789545551.730808:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1789545551.730986:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1789545551.731522:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1789545551.731675:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1789545551.731822:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1789545551.732134:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1789545551.732280:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1789545551.732550:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1789545551.732675:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1789545551.733140:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1789545551.733282:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1789545551.733565:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1789545551.733697:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1789545551.734110:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1789545551.734258:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1789545551.734686:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1789545551.735011:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1789545551.735155:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1789545551.735295:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1789545551.735485:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1789545551.735627:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1789545551.735762:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1789545551.735907:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1789545551.736039:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1789545551.736192:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1789545551.736311:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1789545551.736498:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1789545551.736622:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1789545551.736761:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1789545551.736928:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1789545551.737094:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1789545551.737229:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1789545551.743710:0:5827:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1789545551.774789:0:5880:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1789545551.827660:0:5827:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789545551.827698:0:5827:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa45001c9f988 00100000:10000000:0.0:1789545551.827707:0:5827:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789545551.829002:0:5827:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789545551.829018:0:5827:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.116@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789545551.829049:0:5827:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1789545551.829075:0:5827:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1789545551.898929:0:5880:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789545551.899004:0:5880:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789545551.899008:0:5880:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1789545552.702592:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545553.724552:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545554.750120:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545555.772578:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789545556.293204:0:6123:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg116-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1789545556.540653:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789545556.540665:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789545556.540668:0:8:0:(import.c:65:import_set_state_nolock()) 00000000d1a17f3d lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789545556.540683:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000d1a17f3d using connection 192.168.201.116@tcp/0@lo 00000100:00100000:3.0:1789545556.540703:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000047488dd6 x1876474454871296/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789545556.540738:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000047488dd6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876474454871296:0@lo:38: 00000100:00100000:3.0:1789545556.540811:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545556.540962:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000165efeac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beb86ab1-4563-44b1-afd1-f08a43b0622e:3313:1876474454871168:0@lo:400: 00000100:00100000:0.0:1789545556.540996:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545556.541290:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454871168 00000100:00100000:3.0:1789545556.541306:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454871168 00000100:00100000:3.0:1789545556.541391:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789545556.541399:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002a1d9b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+11:3313:x1876474454871168:12345-0@lo:400: 00000100:00100000:3.0:1789545556.541450:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002a1d9b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+11:3313:x1876474454871168:12345-0@lo:400: Request processed in 53us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545556.541458:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789545556.541810:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000165efeac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beb86ab1-4563-44b1-afd1-f08a43b0622e:3313:1876474454871168:0@lo:400: 00000100:00100000:2.0:1789545556.542620:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454871296 00000100:00100000:2.0:1789545556.542631:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454871296 00000100:00100000:2.0:1789545556.542669:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789545556.542676:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006ee9d46f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1876474454871296:12345-0@lo:38: 00010000:00080000:2.0:1789545556.542702:0:5848:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:2.0:1789545556.542739:0:5848:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x64919c0f856c03b4 00000004:00100000:2.0:1789545556.542859:0:5848:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789545556.543642:0:5848:0:(import.c:65:import_set_state_nolock()) 00000000c0d636be : changing import state from RECOVER to FULL 00010000:00080000:3.0:1789545556.545559:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000047488dd6 x1876474454871296/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789545566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789545556.545580:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789545556.545589:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789545556.545595:0:3310:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789545556.545598:0:3310:0:(import.c:65:import_set_state_nolock()) 00000000d1a17f3d lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789545556.545604:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000047488dd6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876474454871296:0@lo:38: 00000100:00100000:2.0:1789545556.545871:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006ee9d46f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876474454871296:12345-0@lo:38: Request processed in 1094us (2959us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545556.545885:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789545556.803849:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789545557.052567:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789545557.052576:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff994bc4a49800 from 3 10000000:01000000:0.0:1789545557.052581:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789545557.052627:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: 00000000d0f9331e/0x64919c0f856c03bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545557.052640:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: 00000000d0f9331e/0x64919c0f856c03bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545557.052651:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: 00000000d0f9331e/0x64919c0f856c03bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545557.052679:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f0c2afa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454871424:0@lo:101: 00000100:00100000:0.0:1789545557.053241:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545557.053304:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set 000000001d6233fe going to sleep for 11 seconds 00000100:00100000:2.0:1789545557.053385:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454871424 00000100:00100000:2.0:1789545557.053393:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454871424 00000100:00100000:2.0:1789545557.053433:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789545557.053445:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f95e9705 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+11:5843:x1876474454871424:12345-0@lo:101: 00010000:00010000:2.0:1789545557.053457:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545557.053467:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000048b2a4d9/0x64919c0f856c03c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c03bb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545557.053485:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000048b2a4d9/0x64919c0f856c03c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c03bb expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545557.053493:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000048b2a4d9/0x64919c0f856c03c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c03bb expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545557.053499:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000048b2a4d9, rc 0) 00000100:00100000:2.0:1789545557.053534:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f95e9705 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:5843:x1876474454871424:12345-0@lo:101: Request processed in 90us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545557.053538:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789545557.053756:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f0c2afa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454871424:0@lo:101: 00010000:00010000:0.0:1789545557.053772:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: 00000000d0f9331e/0x64919c0f856c03bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c03c2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545557.053785:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: 00000000d0f9331e/0x64919c0f856c03bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c03c2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545557.053831:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f0c2afa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454871552:0@lo:256: 00000100:00100000:0.0:1789545557.053862:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545557.053882:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set 000000001d6233fe going to sleep for 11 seconds 00000100:00100000:0.0:1789545557.053895:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454871552 00000100:00100000:0.0:1789545557.053899:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454871552 00000100:00100000:0.0:1789545557.053923:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789545557.053929:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000aa28ca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:5843:x1876474454871552:12345-0@lo:256: 20000000:01000000:0.0:1789545557.053941:0:5839:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789545557.053954:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789545557.053957:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789545557.054037:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000aa28ca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:5843:x1876474454871552:12345-0@lo:256: Request processed in 108us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545557.054044:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789545557.054074:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f0c2afa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454871552:0@lo:256: 10000000:01000000:0.0:1789545557.054108:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789545557.054114:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: 00000000d0f9331e/0x64919c0f856c03bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c03c2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545557.054122:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: 00000000d0f9331e/0x64919c0f856c03bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c03c2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545557.821969:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545558.844701:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545559.868616:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545560.893549:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789545560.976939:0:6324:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd19028b0 20000000:00000080:0.0:1789545560.976961:0:6324:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff994bc6573000 uarg=0000000000000000 20000000:01000000:0.0:1789545560.976997:0:6324:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789545560.977012:0:6324:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789545560.977017:0:6324:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789545560.977228:0:6324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1789545560.977242:0:6324:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1789545560.982883:0:6324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789545560.983132:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789545560.983188:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1789545560.983245:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1789545560.983261:0:6324:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789545560.983278:0:6324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e478bf5d/0x64919c0f856c03c9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545560.983305:0:6324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009c0d37c5/0x64919c0f856c038a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0383 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545560.983313:0:6324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e478bf5d/0x64919c0f856c03c9 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545560.984560:0:6324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009c0d37c5/0x64919c0f856c038a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c0383 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545560.984579:0:6324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009c0d37c5/0x64919c0f856c038a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c0383 expref: 11 pid: 5839 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545560.984593:0:6324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f0c2afa pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6324:1876474454871680:0@lo:104: 00000100:00100000:0.0:1789545560.984659:0:6324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545560.984719:0:6324:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c0406930 going to sleep for 11 seconds 00000100:00100000:3.0:1789545560.984818:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454871680 00000100:00100000:3.0:1789545560.984827:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454871680 00000100:00100000:3.0:1789545560.984884:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789545560.984894:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cb1eb8ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+3:6324:x1876474454871680:12345-0@lo:104: 00010000:00010000:3.0:1789545560.984907:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: 00000000cba457a8/0x64919c0f856c0383 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c038a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545560.984974:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789545560.984980:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cb1eb8ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+3:6324:x1876474454871680:12345-0@lo:104: Request processed in 88us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545560.985000:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789545560.985040:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789545560.985045:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: 00000000cba457a8/0x64919c0f856c0383 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c038a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545560.985053:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cba457a8 already unused, calling callback (00000000ba87aa7f) 10000000:00010000:3.0:1789545560.985056:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: 00000000cba457a8/0x64919c0f856c0383 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c038a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545560.985063:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: 00000000cba457a8/0x64919c0f856c0383 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c038a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789545560.985069:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: 00000000cba457a8/0x64919c0f856c0383 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c038a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789545560.985074:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789545560.985101:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: 00000000cba457a8/0x64919c0f856c0383 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c038a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545560.985108:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789545560.985124:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: 00000000cba457a8/0x64919c0f856c0383 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c038a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545560.985130:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: 00000000cba457a8/0x64919c0f856c0383 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c038a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545560.985147:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545560.985149:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545560.985150:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789545560.985164:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789545560.985181:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000047488dd6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beb86ab1-4563-44b1-afd1-f08a43b0622e:3313:1876474454871808:0@lo:103: 00000100:00100000:3.0:1789545560.985210:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545560.985238:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454871808 00000100:00100000:3.0:1789545560.985242:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454871808 00010000:00010000:3.0:1789545560.985258:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009c0d37c5/0x64919c0f856c038a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c0383 expref: 12 pid: 5839 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545560.985292:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789545560.985299:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000094795c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:3313:x1876474454871808:12345-0@lo:103: 00010000:00010000:3.0:1789545560.985309:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545560.985314:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009c0d37c5/0x64919c0f856c038a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c0383 expref: 12 pid: 5839 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545560.985323:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009c0d37c5/0x64919c0f856c038a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c0383 expref: 12 pid: 5839 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545560.985339:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e478bf5d/0x64919c0f856c03c9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545560.985346:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e478bf5d/0x64919c0f856c03c9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545560.985389:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e478bf5d/0x64919c0f856c03c9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545560.985396:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e478bf5d/0x64919c0f856c03c9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545560.985402:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e478bf5d/0x64919c0f856c03c9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545560.985408:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e478bf5d/0x64919c0f856c03c9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545560.985419:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e478bf5d already unused, calling callback (000000001ba914cd) 00010000:00010000:3.0:1789545560.985422:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e478bf5d/0x64919c0f856c03c9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545560.985429:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e478bf5d/0x64919c0f856c03c9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545560.985437:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e478bf5d/0x64919c0f856c03c9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545560.985447:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545560.985476:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000094795c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:3313:x1876474454871808:12345-0@lo:103: Request processed in 178us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545560.985483:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789545560.985520:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000047488dd6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beb86ab1-4563-44b1-afd1-f08a43b0622e:3313:1876474454871808:0@lo:103: 00010000:00010000:1.0:1789545560.986486:0:6324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009c0d37c5/0x64919c0f856c038a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c0383 expref: 11 pid: 5839 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545560.986503:0:6324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f0c2afa pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6324:1876474454871680:0@lo:104: 00010000:00010000:1.0:1789545560.986519:0:6324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e478bf5d/0x64919c0f856c03c9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545560.986527:0:6324:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e478bf5d/0x64919c0f856c03c9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545560.986532:0:6324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e478bf5d/0x64919c0f856c03c9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545560.986538:0:6324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e478bf5d/0x64919c0f856c03c9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545561.660684:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000055beef05 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454871936:0@lo:400: 00000100:00100000:3.0:1789545561.660753:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545561.660816:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789545561.660822:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6108edf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454872064:0@lo:400: 00000100:00100000:3.0:1789545561.660848:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545561.660905:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454872064 00000100:00100000:3.0:1789545561.660912:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454872064 00000100:00100000:3.0:1789545561.660956:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789545561.660965:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000047488dd6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454872064:12345-0@lo:400: 00000100:00100000:3.0:1789545561.661019:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000047488dd6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454872064:12345-0@lo:400: Request processed in 56us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545561.661026:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789545561.661092:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c6108edf x1876474454872064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545561.661108:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6108edf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454872064:0@lo:400: 00000100:00100000:2.0:1789545561.661229:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454871936 00000100:00100000:2.0:1789545561.661234:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454871936 00000100:00100000:2.0:1789545561.661283:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789545561.661290:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004ac03609 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+11:3311:x1876474454871936:12345-0@lo:400: 00000100:00100000:2.0:1789545561.661332:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004ac03609 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+11:3311:x1876474454871936:12345-0@lo:400: Request processed in 44us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545561.661339:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789545561.661508:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000055beef05 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454871936:0@lo:400: 00010000:00010000:3.0:1789545561.927568:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545562.941094:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789545563.454153:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789545563.454160:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994bc4a49800 from 1 10000000:01000000:1.0:1789545563.454165:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789545563.454206:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: 00000000ee75e254/0x64919c0f856c03d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545563.454218:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: 00000000ee75e254/0x64919c0f856c03d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545563.454227:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: 00000000ee75e254/0x64919c0f856c03d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545563.454278:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce395c5c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454872192:0@lo:101: 00000100:00100000:1.0:1789545563.454342:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545563.454415:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set 000000005eef2d79 going to sleep for 11 seconds 00000100:00100000:3.0:1789545563.456666:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454872192 00000100:00100000:3.0:1789545563.456689:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454872192 00000100:00100000:3.0:1789545563.456753:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789545563.456762:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000086f4d283 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+11:5843:x1876474454872192:12345-0@lo:101: 00010000:00010000:3.0:1789545563.456779:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545563.456797:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004fcd3cd3/0x64919c0f856c03d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c03d0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545563.456833:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004fcd3cd3/0x64919c0f856c03d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c03d0 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545563.456843:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004fcd3cd3/0x64919c0f856c03d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c03d0 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545563.456851:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004fcd3cd3, rc 0) 00000100:00100000:3.0:1789545563.456924:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000086f4d283 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:5843:x1876474454872192:12345-0@lo:101: Request processed in 164us (2582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545563.456932:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789545563.456989:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce395c5c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454872192:0@lo:101: 00010000:00010000:3.0:1789545563.457005:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: 00000000ee75e254/0x64919c0f856c03d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c03d7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545563.457044:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: 00000000ee75e254/0x64919c0f856c03d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c03d7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545563.457108:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008c325594 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454872320:0@lo:501: 00000100:00100000:3.0:1789545563.457139:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545563.457159:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef8bb28b going to sleep for 11 seconds 00000100:00100000:3.0:1789545563.457173:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454872320 00000100:00100000:3.0:1789545563.457177:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454872320 00000100:00100000:3.0:1789545563.457197:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789545563.457203:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000316b1942 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:5843:x1876474454872320:12345-0@lo:501: 00000100:00100000:3.0:1789545563.457495:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000316b1942 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:5843:x1876474454872320:12345-0@lo:501: Request processed in 292us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545563.457503:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789545563.457537:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008c325594 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454872320:0@lo:501: 00000100:00100000:3.0:1789545563.457565:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008c325594 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454872448:0@lo:503: 00000100:00100000:3.0:1789545563.457601:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545563.457615:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef8bb28b going to sleep for 11 seconds 00000100:00100000:3.0:1789545563.457625:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454872448 00000100:00100000:3.0:1789545563.457629:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454872448 00000100:00100000:3.0:1789545563.457649:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789545563.457654:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e66c9f39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:5843:x1876474454872448:12345-0@lo:503: 00000100:00100000:3.0:1789545563.457798:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e66c9f39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:5843:x1876474454872448:12345-0@lo:503: Request processed in 144us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545563.457804:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789545563.457841:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008c325594 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454872448:0@lo:503: 00000100:00100000:3.0:1789545563.458012:0:6397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008c325594 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:6397:1876474454872576:0@lo:502: 00000100:00100000:3.0:1789545563.458058:0:6397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545563.458077:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454872576 00000100:00100000:3.0:1789545563.458081:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454872576 00000100:00100000:3.0:1789545563.458102:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789545563.458108:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c9b21a09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:6397:x1876474454872576:12345-0@lo:502: 00000100:00100000:3.0:1789545563.458222:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c9b21a09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:6397:x1876474454872576:12345-0@lo:502: Request processed in 114us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545563.458229:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789545563.458273:0:6397:0:(client.c:2716:ptlrpc_set_wait()) set 0000000065691d75 going to sleep for 11 seconds 00000100:00100000:3.0:1789545563.458286:0:6397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008c325594 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:6397:1876474454872576:0@lo:502: 00000020:01000000:3.0:1789545563.458309:0:6397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789545563.458318:0:6397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789545563.458320:0:6397:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789545563.458327:0:6397:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff994bc4a49800 00000020:00000080:3.0:1789545563.458330:0:6397:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789545563.458393:0:6397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:6397:1876474454872704:0@lo:502: 00000100:00100000:3.0:1789545563.458428:0:6397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545563.458447:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454872704 00000100:00100000:3.0:1789545563.458451:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454872704 00000100:00100000:3.0:1789545563.458472:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789545563.458479:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:6397:x1876474454872704:12345-0@lo:502: 00000100:00100000:3.0:1789545563.458584:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:6397:x1876474454872704:12345-0@lo:502: Request processed in 105us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545563.458591:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789545563.458620:0:6397:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc9f49900 going to sleep for 11 seconds 00000100:00100000:3.0:1789545563.458632:0:6397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:6397:1876474454872704:0@lo:502: 00000020:01000000:3.0:1789545563.458657:0:6397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789545563.458661:0:6397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789545563.458664:0:6397:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789545563.458667:0:6397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789545563.458715:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789545563.458730:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789545563.458739:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bee11a600/0x64919c0f856c03d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c03d7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545563.458750:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bee11a600/0x64919c0f856c03d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c03d7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545563.969434:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545564.988523:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545566.012504:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545566.782997:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876474454872960:0@lo:400: 00000100:00100000:2.0:1789545566.783081:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545566.783136:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789545566.783143:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beb86ab1-4563-44b1-afd1-f08a43b0622e:3314:1876474454872832:0@lo:400: 00000100:00100000:2.0:1789545566.783196:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545566.783232:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454872960 00000100:00100000:2.0:1789545566.783240:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454872960 00000100:00100000:2.0:1789545566.783282:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789545566.783291:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876474454872960:12345-0@lo:400: 00000100:00100000:2.0:1789545566.783341:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876474454872960:12345-0@lo:400: Request processed in 51us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545566.783348:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789545566.783409:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff994be54c6d80 x1876474454872960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545566.783423:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876474454872960:0@lo:400: 00000100:00100000:3.0:1789545566.784131:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454872832 00000100:00100000:3.0:1789545566.784139:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454872832 00000100:00100000:3.0:1789545566.790932:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789545566.790953:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:3314:x1876474454872832:12345-0@lo:400: 00000100:00100000:3.0:1789545566.792009:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:3314:x1876474454872832:12345-0@lo:400: Request processed in 1060us (8807us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545566.792020:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789545566.792356:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beb86ab1-4563-44b1-afd1-f08a43b0622e:3314:1876474454872832:0@lo:400: 00010000:00010000:2.0:1789545567.042942:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789545567.647618:0:6688:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789545567.647623:0:6688:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1789545567.647775:0:6688:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff994bc8231800 00000020:01000004:0.0:1789545567.647793:0:6688:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1789545567.647811:0:6688:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789545567.647825:0:6688:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff994bd8da3380) 00000020:00000080:0.0:1789545567.647839:0:6688:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789545567.668023:0:6688:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1789545567.668503:0:6688:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789545567.701540:0:6688:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789545567.710706:0:6688:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789545567.710925:0:6688:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789545567.710967:0:6688:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789545567.710982:0:6688:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789545567.712460:0:6688:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789545567.712485:0:6688:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789545567.712496:0:6688:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x64919c0f856c03e5 00000020:01000004:3.0:1789545567.712504:0:6688:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789545567.712522:0:6688:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.116@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789545567.712524:0:6688:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789545567.712528:0:6688:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789545567.712531:0:6688:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789545567.712542:0:6688:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff994be75acd40) 00000020:00000080:3.0:1789545567.712551:0:6688:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1789545567.718424:0:6688:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789545567.718607:0:6688:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789545567.718613:0:6688:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789545567.719475:0:6688:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789545567.719483:0:6688:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789545567.719825:0:6688:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789545567.719831:0:6688:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789545567.721326:0:6688:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789545567.721700:0:6688:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789545567.721707:0:6688:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789545567.723083:0:6688:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789545567.723092:0:6688:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789545567.754337:0:6688:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789545567.754706:0:6688:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789545567.754713:0:6688:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789545567.757541:0:6688:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789545567.757556:0:6688:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789545567.761457:0:6688:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789545567.761473:0:6688:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789545567.767706:0:6688:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789545567.768086:0:6688:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789545567.768093:0:6688:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789545567.769065:0:6688:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789545567.769075:0:6688:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789545567.822857:0:6688:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789545567.823969:0:6688:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789545567.823976:0:6688:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789545567.827988:0:6688:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789545567.828003:0:6688:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789545567.828518:0:6688:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789545567.828558:0:6688:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789545567.828564:0:6688:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.116@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789545567.857910:0:6688:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.116@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789545567.857965:0:6688:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.116@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1789545567.857969:0:6688:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789545567.857971:0:6688:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789545567.857972:0:6688:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789545567.857973:0:6688:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789545567.857974:0:6688:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789545567.857975:0:6688:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789545567.857976:0:6688:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789545567.857977:0:6688:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789545567.857979:0:6688:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789545567.857980:0:6688:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789545567.857981:0:6688:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789545567.857984:0:6688:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1789545567.857986:0:6688:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789545567.857988:0:6688:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789545567.857989:0:6688:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789545567.857990:0:6688:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789545567.857991:0:6688:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789545567.857992:0:6688:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789545567.857992:0:6688:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789545567.857993:0:6688:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789545567.857994:0:6688:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789545567.857995:0:6688:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789545567.857996:0:6688:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789545567.858022:0:6688:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789545567.858040:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454873088:0@lo:253: 00000100:00100000:3.0:1789545567.858121:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545567.858208:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc64d4000 going to sleep for 11 seconds 00000100:00100000:2.0:1789545567.858218:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454873088 00000100:00100000:2.0:1789545567.858236:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454873088 00000100:00100000:2.0:1789545567.858337:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789545567.858352:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:6688:x1876474454873088:12345-0@lo:253: 20000000:01000000:2.0:1789545567.858426:0:5839:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789545567.858432:0:5839:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1789545567.858437:0:5839:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1789545567.858441:0:5839:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1789545567.859476:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789545567.859708:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1789545567.859723:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1789545567.859760:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1789545567.859768:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1789545567.859792:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1789545567.859832:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1789545567.860186:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1789545567.860207:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.116@tcp 20000000:01000000:2.0:1789545567.860209:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.116@tcp (null) (null) (null) 00000040:00080000:2.0:1789545567.860244:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1789545567.860253:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789545567.860302:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1789545567.860310:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.116@tcp (null) (null) 00000040:00080000:2.0:1789545567.860342:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1789545567.860389:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1789545567.860425:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1789545567.860478:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1789545567.861132:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1789545567.861147:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.116@tcp 20000000:01000000:2.0:1789545567.861149:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.116@tcp (null) (null) (null) 00000040:00080000:2.0:1789545567.861545:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1789545567.861556:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789545567.861647:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1789545567.861655:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.116@tcp (null) (null) 00000040:00080000:2.0:1789545567.861717:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1789545567.861728:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1789545567.861762:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1789545567.861795:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1789545567.861811:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1789545567.861815:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1789545567.861823:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789545567.861830:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789545567.861832:0:5839:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789545567.861848:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789545567.861850:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789545567.861888:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789545567.861891:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789545567.863320:0:6703:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1789545567.863462:0:6703:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1789545567.863527:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1789545567.865855:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1789545567.865906:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1789545567.865977:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1789545567.865991:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789545567.865994:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789545567.869298:0:6704:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1789545567.869493:0:6704:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1789545567.870692:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1789545567.871700:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1789545567.871904:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1789545567.871937:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1789545567.871951:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789545567.871953:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789545567.876696:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1789545567.877075:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1789545567.877127:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1789545567.877224:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:0.0:1789545567.877245:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789545567.877267:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff994bc0030000/0x64919c0f856c03f3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545567.877285:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bee11bc00/0x64919c0f856c030c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0305 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545567.877292:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bc0031e00/0x64919c0f856c0328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0321 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545567.877298:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bc0031400/0x64919c0f856c0398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0391 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545567.877305:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff994bc0030000/0x64919c0f856c03f3 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545567.877344:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bc0031400/0x64919c0f856c0398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c0391 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545567.877413:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994bc0031400/0x64919c0f856c0398 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c0391 expref: 12 pid: 5839 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545567.877429:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876474454873216:0@lo:104: 00000100:00100000:0.0:1789545567.877493:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789545567.877570:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bc0031e00/0x64919c0f856c0328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c0321 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545567.877579:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994bc0031e00/0x64919c0f856c0328 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c0321 expref: 12 pid: 5840 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545567.877588:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876474454873344:0@lo:104: 00000100:00100000:0.0:1789545567.877610:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789545567.877635:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bee11bc00/0x64919c0f856c030c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c0305 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545567.877644:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994bee11bc00/0x64919c0f856c030c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c0305 expref: 12 pid: 5839 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545567.877651:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876474454873472:0@lo:104: 00000100:00100000:0.0:1789545567.877671:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545567.877681:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd9321240 going to sleep for 11 seconds 00000100:00100000:3.0:1789545567.877868:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454873216 00000100:00100000:1.0:1789545567.877872:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454873344 00000100:00100000:3.0:1789545567.877888:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454873216 00000100:00100000:1.0:1789545567.877889:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454873344 00000100:00100000:1.0:1789545567.877950:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454873472 00000100:00100000:1.0:1789545567.877955:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454873472 00000100:00100000:3.0:1789545567.877961:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789545567.877980:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+5:5839:x1876474454873344:12345-0@lo:104: 00010000:00010000:3.0:1789545567.878000:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994bc49d0e00/0x64919c0f856c0321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c0328 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545567.878124:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789545567.878145:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+5:5839:x1876474454873344:12345-0@lo:104: Request processed in 172us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545567.878150:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876474454873344:0@lo:104: 00000100:00100000:3.0:1789545567.878159:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789545567.878199:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789545567.878211:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+4:5839:x1876474454873216:12345-0@lo:104: 00010000:00010000:1.0:1789545567.878211:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789545567.878226:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bc49d0e00/0x64919c0f856c0321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c0328 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545567.878229:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994bee11a400/0x64919c0f856c0391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c0398 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545567.878256:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0e00 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:1.0:1789545567.878263:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bc49d0e00/0x64919c0f856c0321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c0328 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545567.878274:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bc49d0e00/0x64919c0f856c0321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c0328 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789545567.878282:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bc49d0e00/0x64919c0f856c0321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c0328 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789545567.878298:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789545567.878324:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789545567.878332:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+4:5839:x1876474454873216:12345-0@lo:104: Request processed in 126us (839us total) trans 0 rc 0/0 00010000:00010000:1.0:1789545567.878339:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bc49d0e00/0x64919c0f856c0321 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0328 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545567.878340:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789545567.878356:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789545567.878393:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789545567.878408:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+3:5839:x1876474454873472:12345-0@lo:104: 00010000:00010000:3.0:1789545567.878418:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994bc0031600/0x64919c0f856c0305 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c030c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545567.878422:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bc49d0e00/0x64919c0f856c0321 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0328 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545567.878441:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bc49d0e00/0x64919c0f856c0321 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0328 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545567.878455:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789545567.878459:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bee11a400/0x64919c0f856c0391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c0398 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545567.878465:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bee11a400 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:1.0:1789545567.878468:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bee11a400/0x64919c0f856c0391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c0398 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545567.878475:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bee11a400/0x64919c0f856c0391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c0398 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789545567.878482:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bee11a400/0x64919c0f856c0391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c0398 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789545567.878487:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789545567.878502:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bee11a400/0x64919c0f856c0391 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0398 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545567.878508:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789545567.878513:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bee11a400/0x64919c0f856c0391 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0398 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545567.878519:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bee11a400/0x64919c0f856c0391 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0398 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545567.878535:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545567.878537:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545567.878724:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545567.878748:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454873600:0@lo:103: 00000100:00100000:1.0:1789545567.878789:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545567.878826:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789545567.878832:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454873728:0@lo:103: 00000100:00100000:1.0:1789545567.878852:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545567.878886:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454873600 00000100:00100000:1.0:1789545567.878891:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454873600 00010000:00010000:1.0:1789545567.878910:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bc0031e00/0x64919c0f856c0328 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c0321 expref: 13 pid: 5840 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545567.878931:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454873728 00000100:00100000:1.0:1789545567.878935:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454873728 00010000:00010000:1.0:1789545567.878946:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bc0031400/0x64919c0f856c0398 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c0391 expref: 14 pid: 5839 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545567.878959:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789545567.878967:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:3311:x1876474454873600:12345-0@lo:103: 00010000:00010000:1.0:1789545567.878979:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545567.878984:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bc0031e00/0x64919c0f856c0328 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c0321 expref: 14 pid: 5840 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545567.878992:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bc0031e00/0x64919c0f856c0328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c0321 expref: 14 pid: 5840 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545567.879004:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc0031e00/0x64919c0f856c0328 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c0321 expref: 14 pid: 5840 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545567.879024:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789545567.879057:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:3311:x1876474454873600:12345-0@lo:103: Request processed in 89us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545567.879064:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789545567.879079:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789545567.879087:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:3311:x1876474454873728:12345-0@lo:103: 00010000:00010000:1.0:1789545567.879094:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545567.879098:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bc0031400/0x64919c0f856c0398 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c0391 expref: 12 pid: 5839 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545567.879106:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bc0031400/0x64919c0f856c0398 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c0391 expref: 12 pid: 5839 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545567.879114:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789545567.879135:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:3311:x1876474454873728:12345-0@lo:103: Request processed in 49us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545567.879140:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789545567.879568:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789545567.879578:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+3:5839:x1876474454873472:12345-0@lo:104: Request processed in 1174us (1905us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545567.879701:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789545567.879716:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc0031400/0x64919c0f856c0398 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c0391 expref: 11 pid: 5839 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545567.879732:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876474454873216:0@lo:104: 00010000:00010000:3.0:1789545567.879741:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789545567.879752:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bc0031600/0x64919c0f856c0305 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c030c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545567.879753:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876474454873472:0@lo:104: 00010000:00010000:3.0:1789545567.879770:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc0031600 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:3.0:1789545567.879777:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bc0031600/0x64919c0f856c0305 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c030c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545567.879791:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff994bc0030000/0x64919c0f856c03f3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545567.879836:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bc0031600/0x64919c0f856c0305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c030c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789545567.879847:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bc0031600/0x64919c0f856c0305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c030c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789545567.879854:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789545567.879905:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bc0031600/0x64919c0f856c0305 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c030c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545567.879913:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789545567.879945:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bc0031600/0x64919c0f856c0305 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c030c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545567.879954:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bc0031600/0x64919c0f856c0305 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c030c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545567.879966:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beb86ab1-4563-44b1-afd1-f08a43b0622e:3313:1876474454873856:0@lo:103: 00010000:00010000:3.0:1789545567.879979:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545567.879982:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545567.879985:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545567.880006:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545567.880038:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454873856 00000100:00100000:3.0:1789545567.880047:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454873856 00010000:00010000:3.0:1789545567.880075:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bee11bc00/0x64919c0f856c030c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c0305 expref: 11 pid: 5839 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545567.880107:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789545567.880115:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+11:3313:x1876474454873856:12345-0@lo:103: 00010000:00010000:3.0:1789545567.880129:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545567.880133:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bee11bc00/0x64919c0f856c030c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c0305 expref: 11 pid: 5839 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545567.880150:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bee11bc00/0x64919c0f856c030c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c0305 expref: 11 pid: 5839 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545567.880175:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bee11bc00/0x64919c0f856c030c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c0305 expref: 11 pid: 5839 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545567.880192:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff994bc0030000/0x64919c0f856c03f3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545567.880214:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc0030000/0x64919c0f856c03f3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545567.880232:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994bc0030000/0x64919c0f856c03f3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545567.880239:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994bc0030000/0x64919c0f856c03f3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545567.880245:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff994bc0030000/0x64919c0f856c03f3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545567.880252:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff994bc0030000/0x64919c0f856c03f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545567.880258:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc0030000 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545567.880263:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff994bc0030000/0x64919c0f856c03f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545567.880271:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff994bc0030000/0x64919c0f856c03f3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545567.880696:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454873728:0@lo:103: 00000100:00100000:1.0:1789545567.880711:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454873600:0@lo:103: 00010000:00010000:1.0:1789545567.880738:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545567.882908:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff994bc0030000/0x64919c0f856c03f3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545567.882930:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545567.883145:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+10:3313:x1876474454873856:12345-0@lo:103: Request processed in 3025us (3133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545567.883160:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789545567.884760:0:5839:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff994bc0030000/0x64919c0f856c03f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545567.884778:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff994bc0030000/0x64919c0f856c03f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545567.884786:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc0030000/0x64919c0f856c03f3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789545567.884807:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789545567.890961:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beb86ab1-4563-44b1-afd1-f08a43b0622e:3313:1876474454873856:0@lo:103: 00000100:00100000:1.0:1789545567.990875:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+9:6688:x1876474454873088:12345-0@lo:253: Request processed in 132518us (132745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545567.990889:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789545567.990991:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454873088:0@lo:253: 10000000:01000000:0.0:1789545567.991016:0:6688:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789545567.991020:0:6688:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789545567.991022:0:6688:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789545567.991023:0:6688:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789545567.991025:0:6688:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1789545567.991026:0:6688:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789545567.991027:0:6688:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789545567.991029:0:6688:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789545567.991031:0:6688:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789545567.991033:0:6688:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789545567.991034:0:6688:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789545567.991063:0:6688:0:(tgt_mount.c:101:server_register_mount()) register mount ffff994bc8231800 from lustre-OST0000 10000000:01000000:0.0:1789545567.991097:0:6688:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789545567.991101:0:6688:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789545567.991110:0:6688:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff994bc65dcd40 local copy 10000000:01000000:0.0:1789545567.991115:0:6688:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789545567.991197:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0030000/0x64919c0f856c03fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545567.991311:0:6688:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.116@tcp lock: ffff994bc0030000/0x64919c0f856c03fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545567.991323:0:6688:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc0030000/0x64919c0f856c03fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545567.991349:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454873984:0@lo:101: 00000100:00100000:2.0:1789545567.991571:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545567.991684:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454873984 00000100:00100000:2.0:1789545567.991689:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd9321e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789545567.991700:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454873984 00000100:00100000:3.0:1789545567.992006:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789545567.992017:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+9:6688:x1876474454873984:12345-0@lo:101: 00010000:00010000:3.0:1789545567.992036:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545567.992057:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994c0217f000/0x64919c0f856c0401 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c03fa expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545567.992084:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994c0217f000/0x64919c0f856c0401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c03fa expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545567.992096:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994c0217f000/0x64919c0f856c0401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c03fa expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545567.992106:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217f000, rc 0) 00000100:00100000:3.0:1789545567.992249:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+10:6688:x1876474454873984:12345-0@lo:101: Request processed in 234us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545567.992256:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789545567.992337:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454873984:0@lo:101: 00010000:00010000:2.0:1789545567.992356:0:6688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc0030000/0x64919c0f856c03fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x64919c0f856c0401 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545567.992437:0:6688:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc0030000/0x64919c0f856c03fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x64919c0f856c0401 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545567.992563:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454874112:0@lo:501: 00000100:00100000:2.0:1789545567.992608:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545567.992671:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454874112 00000100:00100000:1.0:1789545567.992691:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454874112 00000100:00100000:1.0:1789545567.992955:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789545567.992965:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+10:6688:x1876474454874112:12345-0@lo:501: 00000100:00100000:1.0:1789545567.993181:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+10:6688:x1876474454874112:12345-0@lo:501: Request processed in 218us (571us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789545567.993188:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789545567.994349:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc640cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789545567.994414:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454874112:0@lo:501: 10000000:01000000:2.0:1789545567.994443:0:6688:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789545567.994487:0:6688:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789545567.994495:0:6688:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0030000/0x64919c0f856c03fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x64919c0f856c0401 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545567.994506:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0030000/0x64919c0f856c03fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x64919c0f856c0401 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545567.994522:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.116@tcp lock: ffff994bc0030000/0x64919c0f856c03fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x64919c0f856c0401 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545567.994598:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789545567.994626:0:6688:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff994bc8231800 10000000:01000000:2.0:1789545567.994632:0:6688:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789545567.994637:0:6688:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff994bc65dcd40 10000000:01000000:2.0:1789545567.994640:0:6688:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789545567.994644:0:6688:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff994bc65dcd40 from 1 10000000:01000000:2.0:1789545567.994647:0:6688:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789545567.994675:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d0800/0x64919c0f856c0408 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545567.994684:0:6688:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc49d0800/0x64919c0f856c0408 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545567.994694:0:6688:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc49d0800/0x64919c0f856c0408 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545567.994711:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454874240:0@lo:101: 00000100:00100000:2.0:1789545567.994830:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545567.994866:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc640c540 going to sleep for 11 seconds 00010000:00010000:3.0:1789545567.994955:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789545567.994962:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bc0030000/0x64919c0f856c03fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x64919c0f856c0401 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545567.994980:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc0030000 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:3.0:1789545567.994984:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bc0030000/0x64919c0f856c03fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x64919c0f856c0401 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545567.994992:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bc0030000/0x64919c0f856c03fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x64919c0f856c0401 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789545567.994999:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bc0030000/0x64919c0f856c03fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x64919c0f856c0401 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789545567.995004:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789545567.995022:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bc0030000/0x64919c0f856c03fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x64919c0f856c0401 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545567.995028:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789545567.995082:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beb86ab1-4563-44b1-afd1-f08a43b0622e:3314:1876474454874368:0@lo:103: 00000100:00100000:1.0:1789545567.995110:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545567.995187:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454874368 00000100:00100000:2.0:1789545567.995194:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454874368 00010000:00010000:3.0:1789545567.995251:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bc0030000/0x64919c0f856c03fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x64919c0f856c0401 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545567.995259:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bc0030000/0x64919c0f856c03fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x64919c0f856c0401 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545567.995281:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545567.995283:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545567.995285:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545567.995291:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454874240 00000100:00100000:0.0:1789545567.995306:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454874240 00000100:00100000:2.0:1789545567.995520:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789545567.995531:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:beb86ab1-4563-44b1-afd1-f08a43b0622e+11:3314:x1876474454874368:12345-0@lo:103: 00010000:00010000:2.0:1789545567.995543:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545567.995556:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994c0217f000/0x64919c0f856c0401 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x64919c0f856c03fa expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545567.995578:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789545567.995655:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:beb86ab1-4563-44b1-afd1-f08a43b0622e+10:3314:x1876474454874368:12345-0@lo:103: Request processed in 126us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545567.995663:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789545567.995710:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789545567.995724:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beb86ab1-4563-44b1-afd1-f08a43b0622e:3314:1876474454874368:0@lo:103: 00000100:00100000:1.0:1789545567.995729:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+9:6688:x1876474454874240:12345-0@lo:101: 00010000:00010000:1.0:1789545567.995750:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545567.995772:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bee11a400/0x64919c0f856c040f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c0408 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545567.995803:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bee11a400/0x64919c0f856c040f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c0408 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545567.995817:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bee11a400/0x64919c0f856c040f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0408 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545567.995825:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bee11a400, rc 0) 00000100:00100000:2.0:1789545567.995927:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454874240:0@lo:101: 00010000:00010000:2.0:1789545567.995943:0:6688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc49d0800/0x64919c0f856c0408 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c040f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545567.995952:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+10:6688:x1876474454874240:12345-0@lo:101: Request processed in 181us (1072us total) trans 0 rc 0/0 00010000:00010000:2.0:1789545567.995956:0:6688:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc49d0800/0x64919c0f856c0408 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c040f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545567.995968:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 10000000:01000000:2.0:1789545567.996001:0:6688:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789545567.996076:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d0800/0x64919c0f856c0408 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c040f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545567.996087:0:6688:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc49d0800/0x64919c0f856c0408 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c040f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789545567.996095:0:6688:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789545567.996101:0:6688:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789545567.996108:0:6688:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789545567.996111:0:6688:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789545567.996133:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d0200/0x64919c0f856c0416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545567.996140:0:6688:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc49d0200/0x64919c0f856c0416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545567.996159:0:6688:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc49d0200/0x64919c0f856c0416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545567.996183:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454874496:0@lo:101: 00000100:00100000:2.0:1789545567.996216:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545567.996312:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc640c540 going to sleep for 11 seconds 00000100:00100000:0.0:1789545567.996350:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454874496 00000100:00100000:0.0:1789545567.996356:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454874496 00000100:00100000:0.0:1789545567.996501:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789545567.996509:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+10:6688:x1876474454874496:12345-0@lo:101: 00010000:00010000:0.0:1789545567.996521:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545567.996532:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc0031400/0x64919c0f856c041d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c0416 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545567.996550:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc0031400/0x64919c0f856c041d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c0416 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545567.996560:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc0031400/0x64919c0f856c041d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0416 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545567.996568:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc0031400, rc 0) 00000100:00100000:0.0:1789545567.996646:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+11:6688:x1876474454874496:12345-0@lo:101: Request processed in 138us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545567.996653:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789545567.996736:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454874496:0@lo:101: 00010000:00010000:2.0:1789545567.996858:0:6688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc49d0200/0x64919c0f856c0416 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c041d expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545567.996867:0:6688:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc49d0200/0x64919c0f856c0416 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c041d expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545567.996963:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454874624:0@lo:501: 00000100:00100000:2.0:1789545567.996990:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545567.997057:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc640c540 going to sleep for 11 seconds 00000100:00100000:0.0:1789545567.997089:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454874624 00000100:00100000:0.0:1789545567.997093:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454874624 00000100:00100000:0.0:1789545567.997155:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789545567.997173:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+11:6688:x1876474454874624:12345-0@lo:501: 00000100:00100000:0.0:1789545567.997434:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+11:6688:x1876474454874624:12345-0@lo:501: Request processed in 270us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545567.997442:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789545567.997514:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454874624:0@lo:501: 00000100:00100000:2.0:1789545567.997543:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454874752:0@lo:503: 00000100:00100000:2.0:1789545567.997579:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545568.008264:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454874752 00000100:00100000:3.0:1789545568.008279:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454874752 00000100:00100000:3.0:1789545568.008347:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789545568.008375:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+11:6688:x1876474454874752:12345-0@lo:503: 00000100:00100000:3.0:1789545568.008807:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+11:6688:x1876474454874752:12345-0@lo:503: Request processed in 450us (11226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545568.008815:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789545568.010931:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc640c540 going to sleep for 10 seconds 00000100:00100000:0.0:1789545568.010968:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454874752:0@lo:503: 00000040:00080000:0.0:1789545568.011425:0:6688:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789545568.011522:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454874880:0@lo:502: 00000100:00100000:0.0:1789545568.011859:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545568.011948:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd9321780 going to sleep for 11 seconds 00000100:00100000:3.0:1789545568.012066:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454874880 00000100:00100000:3.0:1789545568.012073:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454874880 00000100:00100000:3.0:1789545568.012185:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789545568.012199:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+11:6688:x1876474454874880:12345-0@lo:502: 00000100:00100000:3.0:1789545568.012584:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+11:6688:x1876474454874880:12345-0@lo:502: Request processed in 389us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545568.012592:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789545568.012919:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454874880:0@lo:502: 00000040:00080000:0.0:1789545568.013298:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789545568.013517:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789545568.013555:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789545568.013599:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789545568.013766:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789545568.013802:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789545568.013836:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454875008:0@lo:502: 00000100:00100000:0.0:1789545568.013886:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545568.014013:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd9321780 going to sleep for 11 seconds 00000100:00100000:3.0:1789545568.014109:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454875008 00000100:00100000:3.0:1789545568.014116:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454875008 00000100:00100000:3.0:1789545568.014154:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789545568.014172:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+11:6688:x1876474454875008:12345-0@lo:502: 00000100:00100000:3.0:1789545568.014405:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+11:6688:x1876474454875008:12345-0@lo:502: Request processed in 243us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545568.014413:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789545568.014492:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454875008:0@lo:502: 00000040:00080000:0.0:1789545568.014580:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789545568.014590:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1789545568.019199:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789545568.019210:0:6708:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789545568.019217:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789545568.019219:0:6708:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789545568.019225:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789545568.019241:0:6708:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff994be75ab380) 00000020:00000080:3.0:1789545568.019261:0:6708:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789545568.019267:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789545568.020068:0:6708:0:(tgt_mount.c:153:server_get_mount()) get mount ffff994bc8231800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789545568.020204:0:6708:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789545568.020213:0:6708:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x64919c0f856c042b 00010000:00010000:2.0:1789545568.025052:0:6708:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1789545568.025506:0:6708:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1789545568.027685:0:6708:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789545568.028114:0:6708:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1789545568.034699:0:6708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789545568.035350:0:6708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1789545568.038810:0:6708:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789545568.038828:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789545568.038836:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789545568.038838:0:6708:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789545568.038849:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789545568.038855:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789545568.038858:0:6708:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789545568.038861:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789545568.038864:0:6708:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789545568.038962:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789545568.038967:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789545568.038969:0:6708:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789545568.038973:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789545568.039088:0:6688:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1789545568.039142:0:6688:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789545568.039180:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d0200/0x64919c0f856c0416 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c041d expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545568.039193:0:6688:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc49d0200/0x64919c0f856c0416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c041d expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789545568.039202:0:6688:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994bc8231800 from 1 10000000:01000000:0.0:1789545568.039205:0:6688:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789545568.039242:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0031a00/0x64919c0f856c0432 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545568.039251:0:6688:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc0031a00/0x64919c0f856c0432 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545568.039262:0:6688:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc0031a00/0x64919c0f856c0432 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545568.039284:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454875136:0@lo:101: 00000100:00100000:0.0:1789545568.039396:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545568.039441:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd9321780 going to sleep for 11 seconds 00000100:00100000:3.0:1789545568.039706:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454875136 00000100:00100000:3.0:1789545568.039714:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454875136 00000100:00100000:3.0:1789545568.040858:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789545568.040871:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+11:6688:x1876474454875136:12345-0@lo:101: 00010000:00010000:3.0:1789545568.040886:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545568.040902:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994c0217fa00/0x64919c0f856c0439 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c0432 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545568.040927:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994c0217fa00/0x64919c0f856c0439 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c0432 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545568.040938:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994c0217fa00/0x64919c0f856c0439 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0432 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545568.040946:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217fa00, rc 0) 00000100:00100000:3.0:1789545568.041008:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:6688:x1876474454875136:12345-0@lo:101: Request processed in 142us (1612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545568.041015:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789545568.042505:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454875136:0@lo:101: 00010000:00010000:1.0:1789545568.042546:0:6688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc0031a00/0x64919c0f856c0432 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0439 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545568.042564:0:6688:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc0031a00/0x64919c0f856c0432 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c0439 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545568.042737:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454875264:0@lo:501: 00000100:00100000:1.0:1789545568.042812:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545568.042874:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff994becce8000 going to sleep for 11 seconds 00000100:00100000:2.0:1789545568.043478:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454875264 00000100:00100000:2.0:1789545568.043493:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454875264 00000100:00100000:2.0:1789545568.043551:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789545568.043561:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:6688:x1876474454875264:12345-0@lo:501: 00000100:00100000:2.0:1789545568.045256:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:6688:x1876474454875264:12345-0@lo:501: Request processed in 1690us (2438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545568.045269:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789545568.045546:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454875264:0@lo:501: 00000100:00100000:0.0:1789545568.045627:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454875392:0@lo:503: 00000100:00100000:0.0:1789545568.045686:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545568.045831:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd9321900 going to sleep for 11 seconds 00000100:00100000:3.0:1789545568.045891:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454875392 00000100:00100000:3.0:1789545568.045898:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454875392 00000100:00100000:3.0:1789545568.045980:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789545568.045989:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:6688:x1876474454875392:12345-0@lo:503: 00000100:00100000:3.0:1789545568.046411:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:6688:x1876474454875392:12345-0@lo:503: Request processed in 421us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545568.046421:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789545568.046467:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454875392:0@lo:503: 00000040:00080000:0.0:1789545568.048881:0:6688:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789545568.048974:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454875520:0@lo:502: 00000100:00100000:0.0:1789545568.049051:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545568.049111:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd9321300 going to sleep for 11 seconds 00000100:00100000:2.0:1789545568.049190:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454875520 00000100:00100000:2.0:1789545568.049198:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454875520 00000100:00100000:2.0:1789545568.049253:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789545568.049263:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:6688:x1876474454875520:12345-0@lo:502: 00000100:00100000:2.0:1789545568.049554:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:6688:x1876474454875520:12345-0@lo:502: Request processed in 292us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545568.049562:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789545568.049726:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454875520:0@lo:502: 00000040:00080000:1.0:1789545568.051440:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789545568.051554:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789545568.051635:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454875648:0@lo:502: 00000100:00100000:1.0:1789545568.051737:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545568.051806:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff994becce8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789545568.051893:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454875648 00000100:00100000:3.0:1789545568.051916:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454875648 00000100:00100000:3.0:1789545568.051989:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789545568.052001:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:6688:x1876474454875648:12345-0@lo:502: 00000100:00100000:3.0:1789545568.052539:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:6688:x1876474454875648:12345-0@lo:502: Request processed in 539us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545568.052556:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789545568.056067:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454875648:0@lo:502: 00000040:00080000:0.0:1789545568.056419:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789545568.056441:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789545568.057589:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789545568.057602:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545568.057605:0:6712:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789545568.057612:0:6712:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff994bc8231800 00000020:00000080:2.0:1789545568.057615:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789545568.057638:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789545568.057641:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545568.057643:0:6712:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789545568.057646:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789545568.058119:0:6688:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789545568.058156:0:6688:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789545568.058187:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0031a00/0x64919c0f856c0432 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0439 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545568.058201:0:6688:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc0031a00/0x64919c0f856c0432 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0439 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789545568.058242:0:6688:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789545568.058246:0:6688:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff994bc8231800 10000000:01000000:0.0:1789545568.058249:0:6688:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff994bc8231800 10000000:01000000:0.0:1789545568.058254:0:6688:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789545568.058259:0:6688:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff994bc8231800 from 1 10000000:01000000:0.0:1789545568.058262:0:6688:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789545568.058297:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0030400/0x64919c0f856c0440 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545568.058306:0:6688:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc0030400/0x64919c0f856c0440 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545568.058323:0:6688:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc0030400/0x64919c0f856c0440 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545568.058348:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454875776:0@lo:101: 00000100:00100000:0.0:1789545568.058546:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545568.058605:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd93210c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789545568.058686:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454875776 00000100:00100000:3.0:1789545568.058701:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454875776 00000100:00100000:3.0:1789545568.058776:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789545568.058788:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:6688:x1876474454875776:12345-0@lo:101: 00010000:00010000:3.0:1789545568.058810:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545568.058829:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994c0217f800/0x64919c0f856c0447 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c0440 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545568.058862:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994c0217f800/0x64919c0f856c0447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c0440 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545568.058876:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994c0217f800/0x64919c0f856c0447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0440 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545568.058887:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217f800, rc 0) 00000100:00100000:3.0:1789545568.059036:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:6688:x1876474454875776:12345-0@lo:101: Request processed in 249us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545568.059044:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789545568.059141:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454875776:0@lo:101: 00010000:00010000:0.0:1789545568.059175:0:6688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc0030400/0x64919c0f856c0440 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0447 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545568.059197:0:6688:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc0030400/0x64919c0f856c0440 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c0447 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545568.059294:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454875904:0@lo:501: 00000100:00100000:0.0:1789545568.059328:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545568.059589:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454875904 00000100:00100000:3.0:1789545568.059596:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454875904 00000100:00100000:3.0:1789545568.059709:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789545568.059719:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:6688:x1876474454875904:12345-0@lo:501: 00000100:00100000:0.0:1789545568.060012:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd93210c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789545568.060454:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789545568.068492:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:6688:x1876474454875904:12345-0@lo:501: Request processed in 8765us (9154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545568.068507:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789545568.069426:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454875904:0@lo:501: 00000100:00100000:1.0:1789545568.069493:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454876032:0@lo:503: 00000100:00100000:1.0:1789545568.069555:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545568.069604:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff994becce8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789545568.069673:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454876032 00000100:00100000:2.0:1789545568.069689:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454876032 00000100:00100000:2.0:1789545568.069767:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789545568.069778:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:6688:x1876474454876032:12345-0@lo:503: 00000100:00100000:2.0:1789545568.070092:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:6688:x1876474454876032:12345-0@lo:503: Request processed in 314us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545568.070108:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789545568.071158:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454876032:0@lo:503: 00000040:00080000:3.0:1789545568.071588:0:6688:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789545568.071662:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454876160:0@lo:502: 00000100:00100000:3.0:1789545568.071729:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545568.071911:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdf465540 going to sleep for 11 seconds 00000100:00100000:2.0:1789545568.078776:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454876160 00000100:00100000:2.0:1789545568.078799:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454876160 00000100:00100000:2.0:1789545568.078900:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789545568.079020:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:6688:x1876474454876160:12345-0@lo:502: 00000100:00100000:2.0:1789545568.079485:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:6688:x1876474454876160:12345-0@lo:502: Request processed in 468us (7753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545568.079544:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454876160:0@lo:502: 00000040:00080000:0.0:1789545568.079946:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789545568.080111:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789545568.080151:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789545568.080226:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789545568.080264:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789545568.080310:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789545568.080345:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789545568.080410:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789545568.080456:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789545568.080490:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789545568.080523:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789545568.080570:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789545568.080605:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789545568.080636:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789545568.080699:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789545568.080736:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789545568.080767:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789545568.080811:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789545568.080847:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789545568.080900:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789545568.080948:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789545568.080986:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789545568.081034:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789545568.081095:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789545568.081136:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1789545568.081188:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1789545568.081240:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1789545568.081278:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1789545568.081326:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454876288:0@lo:502: 00000100:00100000:0.0:1789545568.081434:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545568.081487:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd93210c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789545568.081722:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454876288 00000100:00100000:1.0:1789545568.081737:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454876288 00000100:00100000:2.0:1789545568.089997:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789545568.090722:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789545568.090754:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:6688:x1876474454876288:12345-0@lo:502: 00000100:00100000:0.0:1789545568.091070:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:6688:x1876474454876288:12345-0@lo:502: Request processed in 333us (9635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545568.091078:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789545568.091413:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454876288:0@lo:502: 00000040:00080000:3.0:1789545568.091537:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1789545568.091558:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1789545568.092418:0:6713:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789545568.092434:0:6713:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff994be75a8000) 00000020:00000080:3.0:1789545568.092455:0:6713:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1789545568.092527:0:6713:0:(tgt_mount.c:153:server_get_mount()) get mount ffff994bc8231800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789545568.092532:0:6713:0:(tgt_mount.c:187:server_put_mount()) put mount ffff994bc8231800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789545568.092534:0:6713:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994bc8231800 3 00010000:00080000:3.0:1789545568.092560:0:6713:0:(ldlm_lib.c:102:import_set_conn()) imp ffff994bfbcff800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.116@tcp at head 00010000:00010000:3.0:1789545568.096039:0:6713:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1789545568.096503:0:6713:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789545568.096545:0:6713:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789545568.096559:0:6713:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x64919c0f856c0455 00000100:00080000:3.0:1789545568.096571:0:6713:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789545568.096588:0:6713:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff994bfbcff800 using connection 192.168.201.116@tcp/0@lo 00000100:00100000:3.0:1789545568.096804:0:6713:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994bc641ea00 x1876474454876416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789545568.096836:0:6713:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789545568.097008:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1876474454876416:0@lo:38: 00000100:00100000:0.0:1789545568.097075:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545568.097200:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454876416 00000100:00100000:2.0:1789545568.097208:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454876416 00000100:00100000:2.0:1789545568.097256:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789545568.097264:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1876474454876416:12345-0@lo:38: 00010000:00080000:2.0:1789545568.097293:0:5846:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:2.0:1789545568.097324:0:5846:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x64919c0f856c045c 00000004:00100000:2.0:1789545568.097339:0:5846:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789545568.097391:0:5846:0:(import.c:65:import_set_state_nolock()) ffff994bdf93a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789545568.097450:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876474454876416:12345-0@lo:38: Request processed in 185us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545568.097458:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789545568.097673:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994bc641ea00 x1876474454876416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789545578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545568.097686:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789545568.097695:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1789545568.097703:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789545568.097709:0:3310:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789545568.097711:0:3310:0:(import.c:65:import_set_state_nolock()) ffff994bfbcff800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789545568.097716:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1876474454876416:0@lo:38: 00000100:00100000:3.0:1789545568.097851:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454876544:0@lo:400: 00000100:00100000:3.0:1789545568.097884:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545568.097961:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454876544 00000100:00100000:2.0:1789545568.097966:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454876544 00000100:00100000:2.0:1789545568.098003:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789545568.098010:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc641c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454876544:12345-0@lo:400: 00000100:00100000:2.0:1789545568.098056:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc641c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454876544:12345-0@lo:400: Request processed in 47us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545568.098062:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789545568.098412:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994be54d1500 x1876474454876544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545568.098422:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454876544:0@lo:400: 00000040:00080000:0.0:1789545568.099910:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1789545568.100051:0:6688:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1789545568.100074:0:6688:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789545568.100095:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0030400/0x64919c0f856c0440 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0447 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545568.100107:0:6688:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc0030400/0x64919c0f856c0440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0447 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789545568.100153:0:6688:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789545568.100155:0:6688:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789545568.100157:0:6688:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789545568.100158:0:6688:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789545568.100170:0:6688:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789545568.100171:0:6688:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789545568.100173:0:6688:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789545568.100174:0:6688:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789545568.100176:0:6688:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789545568.100177:0:6688:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789545568.100178:0:6688:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789545568.100182:0:6688:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1789545568.100184:0:6688:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789545568.100185:0:6688:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789545568.100186:0:6688:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789545568.100187:0:6688:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789545568.100188:0:6688:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789545568.100189:0:6688:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789545568.100190:0:6688:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789545568.100191:0:6688:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789545568.100192:0:6688:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789545568.100193:0:6688:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789545568.100194:0:6688:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789545568.100217:0:6688:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789545568.100247:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454876672:0@lo:253: 00000100:00100000:2.0:1789545568.100308:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545568.100338:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bedbee0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789545568.100522:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454876672 00000100:00100000:0.0:1789545568.100530:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454876672 00000100:00100000:0.0:1789545568.100570:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789545568.100579:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:6688:x1876474454876672:12345-0@lo:253: 20000000:01000000:0.0:1789545568.100868:0:5839:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789545568.100882:0:5839:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789545568.150489:0:5839:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789545568.150510:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789545568.150578:0:5862:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789545568.150595:0:5862:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789545568.150682:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff994bc49d0e00/0x64919c0f856c0463 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545568.150700:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bc49d0400/0x64919c0f856c03c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c03bb expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545568.150709:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff994bc49d0e00/0x64919c0f856c0463 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545568.150907:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bc49d0400/0x64919c0f856c03c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c03bb expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545568.150921:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994bc49d0400/0x64919c0f856c03c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c03bb expref: 13 pid: 5840 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545568.150936:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d1f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5862:1876474454876800:0@lo:104: 00000100:00100000:2.0:1789545568.150999:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545568.151065:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bedbeee40 going to sleep for 11 seconds 00000100:00100000:0.0:1789545568.152996:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454876800 00000100:00100000:0.0:1789545568.153010:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454876800 00000100:00100000:0.0:1789545568.153069:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789545568.153079:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+3:5862:x1876474454876800:12345-0@lo:104: 00010000:00010000:0.0:1789545568.153096:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994bc0031800/0x64919c0f856c03bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c03c2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545568.153199:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789545568.153205:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+3:5862:x1876474454876800:12345-0@lo:104: Request processed in 129us (2206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545568.153212:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789545568.153234:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789545568.153241:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bc0031800/0x64919c0f856c03bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c03c2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545568.153248:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc0031800 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:0.0:1789545568.153253:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bc0031800/0x64919c0f856c03bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c03c2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545568.153261:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bc0031800/0x64919c0f856c03bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c03c2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789545568.153282:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bc0031800/0x64919c0f856c03bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c03c2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789545568.153288:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789545568.153325:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bc0031800/0x64919c0f856c03bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c03c2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545568.153332:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789545568.153349:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bc0031800/0x64919c0f856c03bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c03c2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545568.153383:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bc0031800/0x64919c0f856c03bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c03c2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545568.153401:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545568.153403:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545568.153405:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545568.153420:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789545568.153434:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454876928:0@lo:103: 00000100:00100000:0.0:1789545568.153478:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545568.153528:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454876928 00000100:00100000:0.0:1789545568.153533:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454876928 00010000:00010000:0.0:1789545568.153554:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bc49d0400/0x64919c0f856c03c2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c03bb expref: 14 pid: 5840 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545568.153575:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789545568.153582:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd9366050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:3311:x1876474454876928:12345-0@lo:103: 00010000:00010000:0.0:1789545568.153592:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789545568.153597:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bc49d0400/0x64919c0f856c03c2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c03bb expref: 14 pid: 5840 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545568.153928:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d1f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5862:1876474454876800:0@lo:104: 00010000:00010000:2.0:1789545568.153949:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff994bc49d0e00/0x64919c0f856c0463 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545568.154002:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bc49d0400/0x64919c0f856c03c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c03bb expref: 14 pid: 5840 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545568.154016:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc49d0400/0x64919c0f856c03c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c03bb expref: 14 pid: 5840 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545568.154028:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff994bc49d0e00/0x64919c0f856c0463 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545568.154037:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc49d0e00/0x64919c0f856c0463 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789545568.154051:0:5831:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003458178s 00010000:00010000:0.0:1789545568.154056:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994bc49d0e00/0x64919c0f856c0463 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545568.154064:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994bc49d0e00/0x64919c0f856c0463 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545568.154071:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff994bc49d0e00/0x64919c0f856c0463 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545568.154078:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff994bc49d0e00/0x64919c0f856c0463 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545568.154083:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0e00 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:0.0:1789545568.154088:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff994bc49d0e00/0x64919c0f856c0463 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545568.154095:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff994bc49d0e00/0x64919c0f856c0463 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545568.157871:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:6688:x1876474454876672:12345-0@lo:253: Request processed in 57286us (57555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545568.157887:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789545568.157998:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:6688:1876474454876672:0@lo:253: 10000000:01000000:3.0:1789545568.158015:0:6688:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789545568.158030:0:6688:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789545568.158031:0:6688:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789545568.158033:0:6688:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789545568.158034:0:6688:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789545568.158036:0:6688:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789545568.158037:0:6688:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789545568.158038:0:6688:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789545568.158040:0:6688:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789545568.158041:0:6688:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789545568.158042:0:6688:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789545568.158044:0:6688:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789545568.158059:0:6688:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1789545568.158908:0:5862:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff994bc49d0e00/0x64919c0f856c0463 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545568.158922:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff994bc49d0e00/0x64919c0f856c0463 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1789545568.161114:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00010000:00010000:0.0:1789545568.161663:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff994bc49d0e00/0x64919c0f856c0463 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545568.161679:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc49d0e00/0x64919c0f856c0463 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545568.161699:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789545568.161894:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd9366050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:3311:x1876474454876928:12345-0@lo:103: Request processed in 8310us (8414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545568.161905:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00080000:10000000:2.0:1789545568.162347:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789545568.162970:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789545568.163149:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00000100:00100000:1.0:1789545568.163477:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454876928:0@lo:103: 00080000:10000000:2.0:1789545568.163594:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789545568.164052:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789545568.165105:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789545568.322257:0:6688:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789545568.322265:0:6688:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789545568.322298:0:6688:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789545568.322431:0:6688:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.116@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789545568.322448:0:6688:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789545568.322473:0:6688:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1789545569.085642:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789545569.920543:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789545569.920550:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff994bc4a49800 from 21 10000000:01000000:2.0:1789545569.920555:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789545569.920941:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d1000/0x64919c0f856c046a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545569.920954:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc49d1000/0x64919c0f856c046a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545569.920966:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc49d1000/0x64919c0f856c046a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545569.920992:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454877056:0@lo:101: 00000100:00100000:2.0:1789545569.921063:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545569.921177:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd1688540 going to sleep for 11 seconds 00000100:00100000:3.0:1789545569.921474:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454877056 00000100:00100000:3.0:1789545569.921484:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454877056 00000100:00100000:2.0:1789545569.922291:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789545569.922303:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:5843:x1876474454877056:12345-0@lo:101: 00010000:00010000:2.0:1789545569.922319:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545569.922338:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc49d0000/0x64919c0f856c0471 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c046a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545569.922482:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc49d0000/0x64919c0f856c0471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c046a expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545569.922495:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc49d0000/0x64919c0f856c0471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c046a expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545569.922504:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0000, rc 0) 00000100:00100000:2.0:1789545569.922945:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:5843:x1876474454877056:12345-0@lo:101: Request processed in 644us (1880us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545569.922953:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789545569.923028:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454877056:0@lo:101: 00010000:00010000:3.0:1789545569.923047:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc49d1000/0x64919c0f856c046a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0471 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545569.923057:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc49d1000/0x64919c0f856c046a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c0471 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545569.923123:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454877184:0@lo:501: 00000100:00100000:3.0:1789545569.923168:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545569.923242:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bedbeeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789545569.923279:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454877184 00000100:00100000:1.0:1789545569.923285:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454877184 00000100:00100000:1.0:1789545569.923353:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789545569.923388:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:5843:x1876474454877184:12345-0@lo:501: 00000100:00100000:1.0:1789545569.927178:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:5843:x1876474454877184:12345-0@lo:501: Request processed in 3812us (4004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545569.927193:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789545569.927705:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454877184:0@lo:501: 00000100:00100000:3.0:1789545569.927764:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454877312:0@lo:503: 00000100:00100000:3.0:1789545569.927816:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545569.928315:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bedbeeb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789545569.932996:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454877312 00000100:00100000:2.0:1789545569.936003:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454877312 00000100:00100000:2.0:1789545569.936067:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789545569.936076:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:5843:x1876474454877312:12345-0@lo:503: 00000100:00100000:2.0:1789545569.936563:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:5843:x1876474454877312:12345-0@lo:503: Request processed in 486us (8745us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545569.936573:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789545569.936687:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454877312:0@lo:503: 00000100:00100000:1.0:1789545569.945251:0:6801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d9a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:6801:1876474454877440:0@lo:502: 00000100:00100000:1.0:1789545569.945507:0:6801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545569.945573:0:6801:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd9321d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789545569.945593:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454877440 00000100:00100000:3.0:1789545569.945602:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454877440 00000100:00100000:3.0:1789545569.945661:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789545569.945671:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:6801:x1876474454877440:12345-0@lo:502: 00000100:00100000:3.0:1789545569.945973:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:6801:x1876474454877440:12345-0@lo:502: Request processed in 303us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545569.945982:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789545569.946109:0:6801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d9a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:6801:1876474454877440:0@lo:502: 00000100:00100000:1.0:1789545569.946174:0:6801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d9a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:6801:1876474454877568:0@lo:502: 00000100:00100000:1.0:1789545569.946209:0:6801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545569.946234:0:6801:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd9321d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789545569.946284:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454877568 00000100:00100000:3.0:1789545569.946289:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454877568 00000100:00100000:3.0:1789545569.946320:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789545569.946328:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:6801:x1876474454877568:12345-0@lo:502: 00000100:00100000:3.0:1789545569.946486:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:6801:x1876474454877568:12345-0@lo:502: Request processed in 158us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545569.946493:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789545569.946603:0:6801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d9a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:6801:1876474454877568:0@lo:502: 00000040:00080000:1.0:1789545569.946627:0:6801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1789545569.946776:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1789545569.946795:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789545569.946804:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d1000/0x64919c0f856c046a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0471 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545569.946815:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc49d1000/0x64919c0f856c046a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0471 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789545569.946824:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789545569.946827:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff994bc4a49800 from 4 10000000:01000000:0.0:1789545569.946829:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789545569.946857:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0031600/0x64919c0f856c0478 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545569.946866:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc0031600/0x64919c0f856c0478 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545569.946876:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc0031600/0x64919c0f856c0478 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545569.946901:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454877696:0@lo:101: 00000100:00100000:0.0:1789545569.946930:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545569.946966:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc9f49b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789545569.947008:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454877696 00000100:00100000:1.0:1789545569.947013:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454877696 00000100:00100000:1.0:1789545569.947043:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789545569.947051:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:5843:x1876474454877696:12345-0@lo:101: 00010000:00010000:1.0:1789545569.947059:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545569.947071:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bee11aa00/0x64919c0f856c047f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c0478 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545569.947090:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bee11aa00/0x64919c0f856c047f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c0478 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545569.947101:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bee11aa00/0x64919c0f856c047f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0478 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545569.947109:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bee11aa00, rc 0) 00000100:00100000:1.0:1789545569.947156:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:5843:x1876474454877696:12345-0@lo:101: Request processed in 106us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545569.947162:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789545569.947221:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454877696:0@lo:101: 00010000:00010000:0.0:1789545569.947232:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc0031600/0x64919c0f856c0478 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c047f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545569.947240:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc0031600/0x64919c0f856c0478 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c047f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545569.947282:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454877824:0@lo:256: 00000100:00100000:0.0:1789545569.947311:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545569.947332:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc9f49b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789545569.947388:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454877824 00000100:00100000:3.0:1789545569.947392:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454877824 00000100:00100000:3.0:1789545569.947410:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789545569.947416:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:5843:x1876474454877824:12345-0@lo:256: 20000000:01000000:3.0:1789545569.947429:0:5839:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789545569.947444:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789545569.947447:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1789545569.947525:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:5843:x1876474454877824:12345-0@lo:256: Request processed in 108us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545569.947532:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789545569.947619:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454877824:0@lo:256: 10000000:01000000:0.0:1789545569.947662:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789545569.947668:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0031600/0x64919c0f856c0478 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c047f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545569.947676:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc0031600/0x64919c0f856c0478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c047f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789545569.947683:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789545569.947685:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1789545569.947687:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789545569.947702:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c0486 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545569.947719:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c0486 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545569.947727:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c0486 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545569.947739:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454877952:0@lo:101: 00000100:00100000:0.0:1789545569.947763:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545569.947787:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdf465b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789545569.947842:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454877952 00000100:00100000:1.0:1789545569.947846:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454877952 00000100:00100000:1.0:1789545569.947864:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789545569.947870:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:5843:x1876474454877952:12345-0@lo:101: 00010000:00010000:1.0:1789545569.947877:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545569.947884:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bee11ae00/0x64919c0f856c048d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c0486 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545569.947898:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bee11ae00/0x64919c0f856c048d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c0486 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545569.947917:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bee11ae00/0x64919c0f856c048d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0486 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545569.947923:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bee11ae00, rc 0) 00000100:00100000:1.0:1789545569.947960:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:5843:x1876474454877952:12345-0@lo:101: Request processed in 89us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545569.947965:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789545569.948048:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454877952:0@lo:101: 00010000:00010000:0.0:1789545569.948058:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c0486 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c048d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545569.948067:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c0486 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c048d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545569.948109:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454878080:0@lo:501: 00000100:00100000:0.0:1789545569.948145:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545569.950309:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdf465b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789545569.954220:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454878080 00000100:00100000:1.0:1789545569.954236:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454878080 00000100:00100000:1.0:1789545569.954300:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789545569.954310:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:5843:x1876474454878080:12345-0@lo:501: 00000100:00100000:1.0:1789545569.954802:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:5843:x1876474454878080:12345-0@lo:501: Request processed in 493us (6654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545569.954811:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789545569.954870:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454878080:0@lo:501: 00000100:00100000:1.0:1789545569.954925:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454878208:0@lo:503: 00000100:00100000:1.0:1789545569.954970:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545569.955044:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8ce6300 going to sleep for 11 seconds 00000100:00100000:0.0:1789545569.961333:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454878208 00000100:00100000:0.0:1789545569.961350:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454878208 00000100:00100000:0.0:1789545569.961575:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789545569.961586:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:5843:x1876474454878208:12345-0@lo:503: 00000100:00100000:0.0:1789545569.961991:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:5843:x1876474454878208:12345-0@lo:503: Request processed in 406us (7020us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545569.961999:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789545569.962271:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454878208:0@lo:503: 00000100:00100000:1.0:1789545569.970120:0:6803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d9a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:6803:1876474454878336:0@lo:502: 00000100:00100000:1.0:1789545569.970229:0:6803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545569.970275:0:6803:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8ce6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789545569.971275:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454878336 00000100:00100000:0.0:1789545569.971287:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454878336 00000100:00100000:0.0:1789545569.972372:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789545569.972388:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:6803:x1876474454878336:12345-0@lo:502: 00000100:00100000:0.0:1789545569.972780:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:6803:x1876474454878336:12345-0@lo:502: Request processed in 395us (2549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545569.972789:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789545569.973107:0:6803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d9a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:6803:1876474454878336:0@lo:502: 00000020:01000000:3.0:1789545569.973155:0:6803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789545569.973163:0:6803:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789545569.973170:0:6803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789545569.973173:0:6803:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789545569.973179:0:6803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789545569.973189:0:6803:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.116@tcp to nid 0x20000c0a8c974 (192.168.201.116@tcp) 00000020:01000000:3.0:1789545569.973212:0:6803:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789545569.973215:0:6803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789545569.973240:0:6803:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff994be40acd40) 00000020:00000080:3.0:1789545569.973261:0:6803:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1789545569.973268:0:6803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789545569.973343:0:6803:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789545569.973349:0:6803:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789545569.973372:0:6803:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x64919c0f856c049b 00010000:00080000:3.0:1789545569.973400:0:6803:0:(ldlm_lib.c:102:import_set_conn()) imp ffff994bfbcfe800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.116@tcp at head 00010000:00010000:3.0:1789545569.973627:0:6803:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1789545570.003246:0:6803:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789545570.003270:0:6803:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789545570.003910:0:6803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789545570.004046:0:6803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789545570.004085:0:6803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1789545570.004172:0:6803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1789545570.004776:0:6808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789545570.004782:0:6808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789545570.005265:0:6803:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789545570.005279:0:6803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789545570.005312:0:6803:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789545570.005337:0:6803:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x64919c0f856c04a2 00000100:00080000:3.0:1789545570.005348:0:6803:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789545570.005383:0:6803:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff994bfbcfe800 using connection 192.168.201.116@tcp/0@lo 00000100:00100000:3.0:1789545570.005423:0:6803:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994bc641d180 x1876474454878464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789545570.005451:0:6803:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1789545570.005486:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876474454878464:0@lo:8: 00000020:01000000:3.0:1789545570.005520:0:6803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789545570.005526:0:6803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789545570.005529:0:6803:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789545570.005533:0:6803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789545570.005538:0:6803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789545570.005540:0:6803:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789545570.005544:0:6803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789545570.005546:0:6803:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789545570.005575:0:6803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:6803:1876474454878592:0@lo:502: 00000100:00100000:3.0:1789545570.005645:0:6803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545570.005705:0:6803:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bf56e7540 going to sleep for 11 seconds 00000100:00100000:1.0:1789545570.005849:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545570.005912:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454878592 00000100:00100000:3.0:1789545570.005919:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454878592 00000100:00100000:3.0:1789545570.005958:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789545570.005968:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:6803:x1876474454878592:12345-0@lo:502: 00000100:00100000:3.0:1789545570.006178:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:6803:x1876474454878592:12345-0@lo:502: Request processed in 211us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545570.006187:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789545570.006211:0:6803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:6803:1876474454878592:0@lo:502: 00000020:01000000:1.0:1789545570.006240:0:6803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789545570.006277:0:6803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789545570.006280:0:6803:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789545570.006284:0:6803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1789545570.006400:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1789545570.006432:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789545570.006443:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c0486 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c048d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545570.006446:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454878720:0@lo:400: 00010000:00010000:3.0:1789545570.006459:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c0486 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c048d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545570.006466:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454878464 10000000:01000000:3.0:1789545570.006469:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 00000100:00100000:0.0:1789545570.006469:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454878464 10000000:01000000:3.0:1789545570.006472:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff994bc65dcd40 from 1 10000000:01000000:3.0:1789545570.006475:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:0.0:1789545570.006491:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789545570.006496:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1876474454878464:12345-0@lo:8: 00010000:00010000:3.0:1789545570.006498:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994c0217f000/0x64919c0f856c04a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545570.006505:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994c0217f000/0x64919c0f856c04a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545570.006513:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994c0217f000/0x64919c0f856c04a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1789545570.006515:0:6691:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000100:00100000:3.0:1789545570.006526:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454878976:0@lo:101: 00000020:00000080:0.0:1789545570.006545:0:6691:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x64919c0f856c04b0 00000100:00100000:1.0:1789545570.006550:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545570.006561:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:0.0:1789545570.006577:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff994bdf6cc800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789545570.006581:0:6691:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1789545570.006585:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1789545570.006678:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789545570.006686:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454878848:0@lo:400: 00000100:00100000:1.0:1789545570.006715:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:0.0:1789545570.006715:0:6691:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789545570.006863:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789545570.006886:0:6691:0:(import.c:65:import_set_state_nolock()) ffff994bdf6ce800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789545570.006931:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8ce6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789545570.006935:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1876474454878464:12345-0@lo:8: Request processed in 439us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545570.006944:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789545570.006962:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994bc641d180 x1876474454878464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789545580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545570.006973:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789545570.006980:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789545570.006988:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:0.0:1789545570.006989:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454878720 00000100:00080000:1.0:1789545570.006993:0:3310:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00100000:0.0:1789545570.006995:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454878720 00000100:00080000:1.0:1789545570.006997:0:3310:0:(import.c:65:import_set_state_nolock()) ffff994bfbcfe800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789545570.007017:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789545570.007023:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876474454878464:0@lo:8: 00000100:00100000:0.0:1789545570.007025:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454878848 00000100:00100000:0.0:1789545570.007030:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454878848 00000004:00080000:1.0:1789545570.007048:0:6808:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1789545570.007058:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789545570.007066:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454878720:12345-0@lo:400: 00000100:00100000:0.0:1789545570.007114:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454878720:12345-0@lo:400: Request processed in 49us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545570.007121:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789545570.007149:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789545570.007158:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454878848:12345-0@lo:400: 00000004:00080000:1.0:1789545570.007173:0:6808:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 183929813119ns, next at 0ns, rc = 0 00000100:00100000:0.0:1789545570.007192:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454878848:12345-0@lo:400: Request processed in 35us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545570.007198:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789545570.007218:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454878976 00000100:00100000:0.0:1789545570.007221:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454878976 00000100:00100000:0.0:1789545570.007242:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789545570.007247:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bf56acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:5843:x1876474454878976:12345-0@lo:101: 00010000:00010000:0.0:1789545570.007255:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545570.007268:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc0031000/0x64919c0f856c04b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c04a9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545570.007291:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc0031000/0x64919c0f856c04b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c04a9 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545570.007301:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc0031000/0x64919c0f856c04b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c04a9 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545570.007310:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc0031000, rc 0) 00000100:00100000:0.0:1789545570.007355:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bf56acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:5843:x1876474454878976:12345-0@lo:101: Request processed in 104us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545570.007403:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1789545570.007436:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789545570.007463:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454878976:0@lo:101: 00010000:00010000:0.0:1789545570.007485:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994c0217f000/0x64919c0f856c04a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c04b7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545570.007493:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994c0217f000/0x64919c0f856c04a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c04b7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545570.007546:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454879104:0@lo:501: 00000100:00100000:0.0:1789545570.007573:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545570.007593:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdf465b40 going to sleep for 11 seconds 00010000:00080000:0.0:1789545570.007612:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994be54c4e00 x1876474454878848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545570.007622:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454878848:0@lo:400: 00010000:00080000:0.0:1789545570.007633:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994be54c7480 x1876474454878720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545570.007641:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454878720:0@lo:400: 00000100:00100000:0.0:1789545570.007661:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454879104 00000100:00100000:0.0:1789545570.007664:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454879104 00000100:00100000:0.0:1789545570.007685:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789545570.007691:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:5843:x1876474454879104:12345-0@lo:501: 00000100:00100000:0.0:1789545570.007901:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:5843:x1876474454879104:12345-0@lo:501: Request processed in 209us (326us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789545570.007909:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789545570.007950:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454879104:0@lo:501: 10000000:01000000:0.0:1789545570.007982:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789545570.007988:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994c0217f000/0x64919c0f856c04a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c04b7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545570.008002:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994c0217f000/0x64919c0f856c04a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c04b7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789545570.054227:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1789545570.097072:0:6809:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789545570.097106:0:6809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6809:1876474454879360:0@lo:7: 00000100:00100000:2.0:1789545570.097187:0:6809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545570.097252:0:6809:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc64cc600 going to sleep for 11 seconds 00000100:00100000:2.0:1789545570.097271:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789545570.097282:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454879232:0@lo:13: 00000100:00100000:2.0:1789545570.097308:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545570.097381:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454879360 00000100:00100000:2.0:1789545570.097391:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454879360 00000100:00100000:2.0:1789545570.097451:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789545570.097461:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6809:x1876474454879360:12345-0@lo:7: 00000100:00080000:3.0:1789545570.099018:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789545570.099050:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454879232 00000100:00100000:3.0:1789545570.099059:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454879232 00000100:00100000:3.0:1789545570.099108:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789545570.099116:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1876474454879232:12345-0@lo:13: 00002000:00000024:3.0:1789545570.099156:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1789545570.099243:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1876474454879232:12345-0@lo:13: Request processed in 127us (1932us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545570.099251:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00002000:00080000:2.0:1789545570.105055:0:6693:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1789545570.105062:0:6693:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789545570.105162:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6809:x1876474454879360:12345-0@lo:7: Request processed in 7699us (7973us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545570.105173:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789545570.105197:0:6809:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994be54d2300 x1876474454879360/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789545586 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545570.105212:0:6809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6809:1876474454879360:0@lo:7: 00000004:00080000:1.0:1789545570.105226:0:6809:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789545570.105275:0:6809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d98000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6809:1876474454879488:0@lo:5: 00000100:00100000:1.0:1789545570.105310:0:6809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545570.105380:0:6809:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc6622240 going to sleep for 11 seconds 00000100:00100000:2.0:1789545570.108413:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454879488 00000100:00100000:2.0:1789545570.108432:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454879488 00000100:00100000:2.0:1789545570.108502:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789545570.108513:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6809:x1876474454879488:12345-0@lo:5: 00002000:00080000:2.0:1789545570.108546:0:6692:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789545570.108550:0:6692:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789545570.108932:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6809:x1876474454879488:12345-0@lo:5: Request processed in 420us (3620us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789545570.108940:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789545570.108989:0:6809:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994bd8d98000 x1876474454879488/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789545586 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545570.109006:0:6809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d98000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6809:1876474454879488:0@lo:5: 00000004:00080000:1.0:1789545570.109021:0:6809:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00010000:00080000:3.0:1789545570.109403:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994be54d2680 x1876474454879232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545570.109422:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454879232:0@lo:13: 00010000:00010000:3.0:1789545570.112059:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545571.138448:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545572.157999:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545573.181653:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789545573.517342:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1789545573.517408:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00010000:00010000:3.0:1789545574.207520:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789545574.374875:0:7060:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg116-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789545575.229498:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545575.484603:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454879744:0@lo:400: 00000100:00100000:0.0:1789545575.484680:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545575.484744:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789545575.484752:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454879872:0@lo:400: 00000100:00100000:0.0:1789545575.484776:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545575.484810:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454879744 00000100:00100000:0.0:1789545575.484818:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454879744 00000100:00100000:0.0:1789545575.484860:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454879872 00000100:00100000:0.0:1789545575.484863:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454879872 00000100:00100000:0.0:1789545575.484891:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789545575.484899:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454879744:12345-0@lo:400: 00000100:00100000:0.0:1789545575.484952:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454879744:12345-0@lo:400: Request processed in 53us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545575.484960:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789545575.484978:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789545575.484985:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454879872:12345-0@lo:400: 00000100:00100000:0.0:1789545575.485011:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454879872:12345-0@lo:400: Request processed in 28us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545575.485017:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1789545575.485056:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789545575.485087:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994be54c4e00 x1876474454879872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545575.485124:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454879872:0@lo:400: 00010000:00080000:0.0:1789545575.485140:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994be54c7480 x1876474454879744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545575.485148:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454879744:0@lo:400: 00000100:00100000:1.0:1789545575.485304:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454880000:0@lo:400: 00000100:00100000:1.0:1789545575.485341:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545575.485418:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789545575.485426:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454879616:0@lo:400: 00000100:00100000:1.0:1789545575.485453:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545575.485527:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454880000 00000100:00100000:0.0:1789545575.485532:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454880000 00000100:00100000:0.0:1789545575.485572:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789545575.485579:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454880000:12345-0@lo:400: 00000100:00100000:0.0:1789545575.485615:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454880000:12345-0@lo:400: Request processed in 37us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545575.485621:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789545575.485643:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454879616 00000100:00100000:0.0:1789545575.485647:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454879616 00000100:00100000:0.0:1789545575.485670:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789545575.485676:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:3311:x1876474454879616:12345-0@lo:400: 00000100:00100000:0.0:1789545575.485704:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:3311:x1876474454879616:12345-0@lo:400: Request processed in 29us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545575.485710:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1789545575.485766:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789545575.485786:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454879616:0@lo:400: 00010000:00080000:1.0:1789545575.485797:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994be54c6300 x1876474454880000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545575.485805:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789545575.485817:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454880000:0@lo:400: 00000100:00100000:3.0:1789545575.488080:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789545575.488086:0:6809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d9b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6809:1876474454880256:0@lo:700: 00000100:00100000:3.0:1789545575.488114:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454880128:0@lo:13: 00000100:00100000:1.0:1789545575.488165:0:6809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545575.488214:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545575.488216:0:6809:0:(client.c:2716:ptlrpc_set_wait()) set ffff994ac26f4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789545575.488293:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454880128 00000100:00100000:3.0:1789545575.488304:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454880128 00000100:00100000:3.0:1789545575.488408:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789545575.488420:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc641c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454880128:12345-0@lo:13: 00002000:00000024:3.0:1789545575.488470:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789545575.488531:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc641c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454880128:12345-0@lo:13: Request processed in 111us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545575.488538:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789545575.488638:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994bd8d98000 x1876474454880128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545591 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545575.488663:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454880128:0@lo:13: 00000100:00100000:0.0:1789545575.488868:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454880256 00000100:00100000:0.0:1789545575.488877:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454880256 00000100:00100000:0.0:1789545575.488925:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789545575.488935:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6809:x1876474454880256:12345-0@lo:700: 00000100:00100000:0.0:1789545575.488979:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6699:1876474454880384:0@lo:700: 00000100:00100000:0.0:1789545575.489022:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545575.489068:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc6622000 going to sleep for 11 seconds 00000100:00100000:3.0:1789545575.489290:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454880384 00000100:00100000:3.0:1789545575.489299:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454880384 00000100:00100000:3.0:1789545575.489396:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789545575.489406:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6699:x1876474454880384:12345-0@lo:700: 40000000:02000000:2.0:1789545575.567058:0:5853:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1789545575.576303:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6699:x1876474454880384:12345-0@lo:700: Request processed in 86891us (87272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545575.576334:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789545575.577416:0:6699:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994be54c7480 x1876474454880384/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789545591 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545575.577433:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6699:1876474454880384:0@lo:700: 40000000:02000000:0.0:1789545575.577450:0:6699:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:0.0:1789545575.666354:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6809:x1876474454880256:12345-0@lo:700: Request processed in 177412us (178184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545575.666393:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789545575.666404:0:6809:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994bd8d9b100 x1876474454880256/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789545591 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545575.666420:0:6809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d9b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6809:1876474454880256:0@lo:700: 00000004:02000040:1.0:1789545575.780594:0:6809:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1789545575.785994:0:6809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d9b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6809:1876474454880512:0@lo:5: 00000100:00100000:1.0:1789545575.786091:0:6809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545575.786148:0:6809:0:(client.c:2716:ptlrpc_set_wait()) set ffff994ac26f4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789545575.786762:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454880512 00000100:00100000:3.0:1789545575.786771:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454880512 00000100:00100000:3.0:1789545575.786831:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789545575.786841:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6809:x1876474454880512:12345-0@lo:5: 00002000:00080000:3.0:1789545575.795405:0:6691:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1789545575.795428:0:6691:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1789545575.804152:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6809:x1876474454880512:12345-0@lo:5: Request processed in 17304us (18054us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789545575.804167:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789545575.808791:0:6809:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994bd8d9b100 x1876474454880512/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789545591 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545575.808814:0:6809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d9b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6809:1876474454880512:0@lo:5: 00000004:00080000:1.0:1789545575.808829:0:6809:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1789545576.256125:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545577.278034:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545578.301219:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789545578.843754:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1789545579.324511:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545580.348675:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545580.604635:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454880640:0@lo:13: 00000100:00100000:1.0:1789545580.604713:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545580.604806:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454880640 00000100:00100000:1.0:1789545580.604813:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454880640 00000100:00100000:1.0:1789545580.604868:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789545580.604881:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454880640:12345-0@lo:13: 00002000:00000024:1.0:1789545580.604927:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789545580.604982:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454880640:12345-0@lo:13: Request processed in 106us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545580.604990:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789545580.605011:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789545580.605042:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994bd8d98000 x1876474454880640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545596 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545580.605052:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789545580.605073:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454880640:0@lo:13: 00000100:00100000:0.0:1789545580.611935:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beb86ab1-4563-44b1-afd1-f08a43b0622e:3314:1876474454880768:0@lo:400: 00000100:00100000:0.0:1789545580.612023:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545580.612187:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454880768 00000100:00100000:2.0:1789545580.612196:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454880768 00000100:00100000:2.0:1789545580.612249:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789545580.612260:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:3314:x1876474454880768:12345-0@lo:400: 00000100:00100000:1.0:1789545580.613647:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876474454881024:0@lo:400: 00000100:00100000:1.0:1789545580.613705:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545580.613760:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789545580.613768:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876474454880896:0@lo:400: 00000100:00100000:1.0:1789545580.613791:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545580.613825:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454881024 00000100:00100000:1.0:1789545580.613832:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454881024 00000100:00100000:1.0:1789545580.613876:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454880896 00000100:00100000:1.0:1789545580.613879:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454880896 00000100:00100000:1.0:1789545580.613895:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789545580.613902:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876474454881024:12345-0@lo:400: 00000100:00100000:1.0:1789545580.613959:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876474454881024:12345-0@lo:400: Request processed in 57us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545580.613966:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789545580.613985:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789545580.613991:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876474454880896:12345-0@lo:400: 00000100:00100000:1.0:1789545580.614020:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876474454880896:12345-0@lo:400: Request processed in 29us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545580.614026:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1789545580.614045:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789545580.614075:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994bd8d9b100 x1876474454880896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545580.614090:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876474454880896:0@lo:400: 00010000:00080000:1.0:1789545580.614100:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994bd8d99f80 x1876474454881024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545580.614107:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876474454881024:0@lo:400: 00000100:00100000:2.0:1789545580.615831:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:3314:x1876474454880768:12345-0@lo:400: Request processed in 3566us (3802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545580.615845:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789545580.621258:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beb86ab1-4563-44b1-afd1-f08a43b0622e:3314:1876474454880768:0@lo:400: 00010000:00010000:2.0:1789545581.376502:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545582.403597:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545583.420535:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789545584.413511:0:7629:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789545584.413515:0:7629:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1789545584.413663:0:7629:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff994bdfb06800 00000020:01000004:2.0:1789545584.413679:0:7629:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789545584.413692:0:7629:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789545584.413705:0:7629:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff994beddc19c0) 00000020:00000080:2.0:1789545584.413720:0:7629:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789545584.427571:0:7629:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789545584.427831:0:7629:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1789545584.445326:0:7629:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00010000:00010000:3.0:1789545584.448461:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1789545584.450219:0:7629:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789545584.450260:0:7629:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1789545584.450318:0:7629:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789545584.450344:0:7629:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1789545584.450835:0:7629:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1789545584.450846:0:7629:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789545584.450857:0:7629:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x64919c0f856c04c5 00000020:01000004:1.0:1789545584.450864:0:7629:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1789545584.450899:0:7629:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.116@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789545584.450903:0:7629:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789545584.450909:0:7629:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1789545584.450929:0:7629:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1789545584.450933:0:7629:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.116@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789545584.467391:0:7629:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.116@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789545584.467430:0:7629:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.116@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1789545584.467434:0:7629:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789545584.467436:0:7629:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789545584.467437:0:7629:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789545584.467439:0:7629:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789545584.467440:0:7629:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789545584.467441:0:7629:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789545584.467442:0:7629:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789545584.467444:0:7629:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789545584.467447:0:7629:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789545584.467448:0:7629:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789545584.467450:0:7629:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789545584.467453:0:7629:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1789545584.467455:0:7629:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789545584.467457:0:7629:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789545584.467458:0:7629:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789545584.467459:0:7629:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789545584.467460:0:7629:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789545584.467461:0:7629:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789545584.467580:0:7629:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789545584.467582:0:7629:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789545584.467583:0:7629:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789545584.467584:0:7629:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789545584.467585:0:7629:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789545584.467614:0:7629:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789545584.467634:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454881152:0@lo:253: 00000100:00100000:0.0:1789545584.467701:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545584.467853:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454881152 00000100:00100000:2.0:1789545584.467862:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454881152 00000100:00100000:2.0:1789545584.467922:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789545584.467932:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:7629:x1876474454881152:12345-0@lo:253: 20000000:01000000:2.0:1789545584.467961:0:5840:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789545584.467965:0:5840:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1789545584.467971:0:5840:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1789545584.467974:0:5840:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1789545584.468942:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789545584.469170:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1789545584.469184:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1789545584.469223:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1789545584.469232:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1789545584.469265:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1789545584.469313:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1789545584.469691:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1789545584.469708:0:5840:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.116@tcp 20000000:01000000:2.0:1789545584.469711:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.116@tcp (null) (null) (null) 00000040:00080000:2.0:1789545584.469745:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1789545584.469753:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789545584.469799:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1789545584.469808:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.116@tcp (null) (null) 00000040:00080000:2.0:1789545584.469839:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1789545584.469848:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789545584.469906:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1789545584.469958:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1789545584.470647:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1789545584.470661:0:5840:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.116@tcp 20000000:01000000:2.0:1789545584.470663:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.116@tcp (null) (null) (null) 00000040:00080000:2.0:1789545584.470691:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1789545584.470697:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789545584.470723:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1789545584.470729:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.116@tcp (null) (null) 00000040:00080000:2.0:1789545584.470754:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1789545584.470761:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789545584.470801:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1789545584.470835:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1789545584.470849:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789545584.470852:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789545584.470856:0:5840:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789545584.470873:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789545584.470876:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000100:00100000:0.0:1789545584.470932:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bedd1ac00 going to sleep for 11 seconds 20000000:01000000:2.0:1789545584.471240:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789545584.471242:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789545584.475586:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1789545584.475684:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1789545584.475744:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1789545584.476077:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1789545584.476119:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1789545584.476177:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1789545584.476186:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789545584.476188:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789545584.476606:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1789545584.476759:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1789545584.476793:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1789545584.476848:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1789545584.476861:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789545584.476864:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789545584.477250:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1789545584.477298:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1789545584.477346:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1789545584.477683:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1789545584.477720:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1789545584.477754:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1789545584.477873:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789545584.477875:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789545584.478416:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1789545584.478482:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1789545584.478517:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1789545584.478761:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1789545584.478987:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1789545584.479039:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1789545584.479123:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1789545584.479127:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1789545584.479137:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789545584.479157:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff994c0217f400/0x64919c0f856c04cc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.479176:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bc0031400/0x64919c0f856c041d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0416 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.479185:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994c0217f800/0x64919c0f856c0447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0440 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.479193:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bc49d0000/0x64919c0f856c0471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c046a expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.479200:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bee11ae00/0x64919c0f856c048d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0486 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.479207:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bc0031000/0x64919c0f856c04b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c04a9 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.479215:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff994c0217f400/0x64919c0f856c04cc lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.479257:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bc0031000/0x64919c0f856c04b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c04a9 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.479273:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994bc0031000/0x64919c0f856c04b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c04a9 expref: 16 pid: 5839 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545584.479296:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1876474454881280:0@lo:104: 00000100:00100000:3.0:1789545584.479441:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789545584.479499:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bee11ae00/0x64919c0f856c048d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c0486 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.479507:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994bee11ae00/0x64919c0f856c048d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c0486 expref: 16 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545584.479516:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1876474454881408:0@lo:104: 00010000:00010000:3.0:1789545584.479543:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bc49d0000/0x64919c0f856c0471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c046a expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545584.479547:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1789545584.479551:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994bc49d0000/0x64919c0f856c0471 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c046a expref: 16 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545584.479558:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1876474454881536:0@lo:104: 00000100:00100000:1.0:1789545584.479564:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545584.479592:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454881280 00000100:00100000:1.0:1789545584.479598:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454881280 00000100:00100000:0.0:1789545584.479612:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454881408 00000100:00100000:0.0:1789545584.479616:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454881408 00000100:00100000:1.0:1789545584.479631:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789545584.479639:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d4a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+4:5840:x1876474454881280:12345-0@lo:104: 00010000:00010000:1.0:1789545584.479650:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994c0217f000/0x64919c0f856c04a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c04b7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545584.479663:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789545584.479683:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994c0217f800/0x64919c0f856c0447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c0440 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.479691:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994c0217f800/0x64919c0f856c0447 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c0440 expref: 16 pid: 5840 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545584.479699:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1876474454881664:0@lo:104: 00000100:00100000:3.0:1789545584.479719:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789545584.479736:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bc0031400/0x64919c0f856c041d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c0416 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545584.479737:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789545584.479742:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d4a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+4:5840:x1876474454881280:12345-0@lo:104: Request processed in 105us (303us total) trans 0 rc 0/0 00010000:00010000:3.0:1789545584.479759:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994bc0031400/0x64919c0f856c041d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c0416 expref: 16 pid: 5840 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545584.479781:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1876474454881792:0@lo:104: 00000100:00100000:3.0:1789545584.479802:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545584.479814:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bedd78180 going to sleep for 11 seconds 00000100:00100000:3.0:1789545584.479832:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1876474454881280:0@lo:104: 00010000:00010000:2.0:1789545584.479833:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789545584.479840:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994c0217f000/0x64919c0f856c04a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c04b7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545584.479848:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217f000 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:2.0:1789545584.479852:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994c0217f000/0x64919c0f856c04a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c04b7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545584.479861:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994c0217f000/0x64919c0f856c04a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c04b7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789545584.479868:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994c0217f000/0x64919c0f856c04a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c04b7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789545584.479875:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789545584.479919:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994c0217f000/0x64919c0f856c04a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c04b7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545584.479926:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789545584.479945:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994c0217f000/0x64919c0f856c04a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c04b7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545584.479952:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994c0217f000/0x64919c0f856c04a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c04b7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545584.479972:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545584.479974:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545584.479975:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545584.480168:0:5829:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1789545584.480176:0:5829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:0.0:1789545584.480197:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789545584.480208:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beb86ab1-4563-44b1-afd1-f08a43b0622e:3314:1876474454881920:0@lo:103: 00000100:00100000:0.0:1789545584.480236:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545584.480329:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454881920 00000100:00100000:3.0:1789545584.480334:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454881920 00010000:00010000:3.0:1789545584.480353:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bc0031000/0x64919c0f856c04b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c04a9 expref: 17 pid: 5839 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545584.480459:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454881536 00000100:00100000:0.0:1789545584.480462:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454881536 00000100:00100000:0.0:1789545584.480479:0:5829:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1789545584.480484:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454881664 00000100:00100000:0.0:1789545584.480486:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454881664 00000100:00100000:0.0:1789545584.480494:0:5829:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1789545584.480509:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454881792 00000100:00100000:0.0:1789545584.480512:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454881792 00000100:00100000:0.0:1789545584.480573:0:7635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789545584.480580:0:7635:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:beb86ab1-4563-44b1-afd1-f08a43b0622e+7:5840:x1876474454881408:12345-0@lo:104: 00010000:00010000:0.0:1789545584.480589:0:7635:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c0486 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c048d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.480638:0:7635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789545584.480649:0:7635:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:beb86ab1-4563-44b1-afd1-f08a43b0622e+7:5840:x1876474454881408:12345-0@lo:104: Request processed in 70us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545584.480656:0:7635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789545584.480673:0:7635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789545584.480680:0:7635:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc641d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:beb86ab1-4563-44b1-afd1-f08a43b0622e+6:5840:x1876474454881536:12345-0@lo:104: 00010000:00010000:0.0:1789545584.480687:0:7635:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994bc49d1000/0x64919c0f856c046a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c0471 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.480727:0:7635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789545584.480732:0:7635:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc641d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:beb86ab1-4563-44b1-afd1-f08a43b0622e+6:5840:x1876474454881536:12345-0@lo:104: Request processed in 54us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545584.480739:0:7635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789545584.480750:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789545584.480756:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c0486 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c048d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.480762:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc0031e00 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:0.0:1789545584.480827:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c0486 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c048d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.480836:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c0486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c048d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789545584.480844:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c0486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c048d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789545584.480849:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789545584.480878:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c0486 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c048d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.480896:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789545584.480907:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c0486 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c048d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.480913:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c0486 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c048d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.480928:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789545584.480931:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bc49d1000/0x64919c0f856c046a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c0471 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.480936:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1000 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:0.0:1789545584.480939:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bc49d1000/0x64919c0f856c046a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c0471 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.480946:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bc49d1000/0x64919c0f856c046a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c0471 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789545584.480952:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bc49d1000/0x64919c0f856c046a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c0471 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789545584.480956:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789545584.480969:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bc49d1000/0x64919c0f856c046a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0471 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.480975:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789545584.480989:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bc49d1000/0x64919c0f856c046a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0471 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.481004:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bc49d1000/0x64919c0f856c046a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0471 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.481014:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545584.481015:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545584.481017:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545584.481029:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beb86ab1-4563-44b1-afd1-f08a43b0622e:3314:1876474454882048:0@lo:103: 00000100:00100000:0.0:1789545584.481053:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545584.481178:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789545584.481187:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:3314:x1876474454881920:12345-0@lo:103: 00010000:00010000:3.0:1789545584.481198:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545584.481204:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bc0031000/0x64919c0f856c04b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c04a9 expref: 17 pid: 5839 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.481216:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bc0031000/0x64919c0f856c04b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c04a9 expref: 17 pid: 5839 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.481231:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc0031000/0x64919c0f856c04b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c04a9 expref: 17 pid: 5839 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.481241:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545584.481269:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:3314:x1876474454881920:12345-0@lo:103: Request processed in 85us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545584.481276:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789545584.483216:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789545584.484772:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789545584.485215:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc641ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+4:5840:x1876474454881664:12345-0@lo:104: 00010000:00010000:1.0:1789545584.485231:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994bc0030400/0x64919c0f856c0440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c0447 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545584.485312:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789545584.485316:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc641ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+4:5840:x1876474454881664:12345-0@lo:104: Request processed in 536us (5598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545584.485322:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789545584.485339:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789545584.485344:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc641ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+3:5840:x1876474454881792:12345-0@lo:104: 00010000:00010000:1.0:1789545584.485349:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994bc49d0200/0x64919c0f856c0416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c041d expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545584.485384:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789545584.485387:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc641ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+3:5840:x1876474454881792:12345-0@lo:104: Request processed in 43us (5585us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545584.485390:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1789545584.485414:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789545584.485418:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bc0030400/0x64919c0f856c0440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c0447 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545584.485424:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc0030400 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:1.0:1789545584.485427:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bc0030400/0x64919c0f856c0440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c0447 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545584.485432:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bc0030400/0x64919c0f856c0440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c0447 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789545584.485449:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bc0030400/0x64919c0f856c0440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c0447 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789545584.485452:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789545584.485914:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bc0030400/0x64919c0f856c0440 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0447 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545584.485922:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789545584.485933:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bc0030400/0x64919c0f856c0440 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0447 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545584.485940:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bc0030400/0x64919c0f856c0440 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0447 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545584.485958:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789545584.485961:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bc49d0200/0x64919c0f856c0416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c041d expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545584.485966:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0200 already unused, calling callback (ffffffffc1d06c20) 00000100:00100000:0.0:1789545584.485967:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beb86ab1-4563-44b1-afd1-f08a43b0622e:3314:1876474454881920:0@lo:103: 10000000:00010000:1.0:1789545584.485968:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bc49d0200/0x64919c0f856c0416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c041d expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545584.485975:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bc49d0200/0x64919c0f856c0416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c041d expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789545584.485981:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bc49d0200/0x64919c0f856c0416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c041d expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789545584.485986:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789545584.486001:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454882304:0@lo:103: 00010000:00010000:1.0:1789545584.486004:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bc49d0200/0x64919c0f856c0416 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c041d expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545584.486008:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789545584.486021:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bc49d0200/0x64919c0f856c0416 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c041d expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545584.486027:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bc49d0200/0x64919c0f856c0416 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c041d expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545584.486034:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789545584.486040:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545584.486042:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545584.486044:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545584.486052:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beb86ab1-4563-44b1-afd1-f08a43b0622e:3313:1876474454882432:0@lo:103: 00000100:00100000:2.0:1789545584.489609:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454882048 00000100:00100000:2.0:1789545584.489627:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454882048 00010000:00010000:2.0:1789545584.489671:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bee11ae00/0x64919c0f856c048d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c0486 expref: 16 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545584.489684:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789545584.489693:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454882304 00000100:00100000:2.0:1789545584.489696:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454882304 00000100:00100000:0.0:1789545584.489696:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454882176:0@lo:103: 00010000:00010000:2.0:1789545584.489705:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994c0217f800/0x64919c0f856c0447 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c0440 expref: 17 pid: 5840 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545584.489718:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789545584.489725:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:3314:x1876474454882048:12345-0@lo:103: 00010000:00010000:2.0:1789545584.489737:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545584.489741:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bee11ae00/0x64919c0f856c048d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c0486 expref: 17 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545584.489747:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789545584.489752:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bee11ae00/0x64919c0f856c048d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c0486 expref: 17 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545584.489772:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789545584.489827:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:3314:x1876474454882048:12345-0@lo:103: Request processed in 102us (8772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545584.489833:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789545584.489849:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454882176 00000100:00100000:2.0:1789545584.489852:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454882176 00010000:00010000:2.0:1789545584.489863:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bc49d0000/0x64919c0f856c0471 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c046a expref: 17 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545584.489900:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789545584.489906:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:3312:x1876474454882304:12345-0@lo:103: 00010000:00010000:2.0:1789545584.489913:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545584.489917:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994c0217f800/0x64919c0f856c0447 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c0440 expref: 17 pid: 5840 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545584.489925:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994c0217f800/0x64919c0f856c0447 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c0440 expref: 17 pid: 5840 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545584.489934:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545584.489942:0:5833:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789545584.489951:0:5833:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1789545584.490093:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545584.490128:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bee11ae00/0x64919c0f856c048d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c0486 expref: 17 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545584.490142:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1876474454881408:0@lo:104: 00000100:00100000:3.0:1789545584.490154:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1876474454881536:0@lo:104: 00010000:00010000:3.0:1789545584.490163:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994c0217f800/0x64919c0f856c0447 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c0440 expref: 16 pid: 5840 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545584.490173:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1876474454881664:0@lo:104: 00000100:00100000:3.0:1789545584.490181:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1876474454881792:0@lo:104: 00010000:00010000:3.0:1789545584.490205:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff994c0217f400/0x64919c0f856c04cc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545584.490284:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545584.490453:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beb86ab1-4563-44b1-afd1-f08a43b0622e:3314:1876474454882048:0@lo:103: 00000100:00100000:0.0:1789545584.490602:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454882432 00000100:00100000:0.0:1789545584.490606:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454882432 00010000:00010000:0.0:1789545584.490623:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bc0031400/0x64919c0f856c041d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c0416 expref: 16 pid: 5840 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545584.490637:0:5833:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789545584.490643:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789545584.490648:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:3312:x1876474454882176:12345-0@lo:103: 00010000:00010000:0.0:1789545584.490655:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789545584.490665:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bc49d0000/0x64919c0f856c0471 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c046a expref: 16 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.490673:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bc49d0000/0x64919c0f856c0471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c046a expref: 16 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.490683:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc49d0000/0x64919c0f856c0471 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c046a expref: 16 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.490692:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545584.490899:0:7636:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1789545584.490904:0:7636:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:0.0:1789545584.491191:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:3312:x1876474454882176:12345-0@lo:103: Request processed in 541us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545584.491199:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789545584.491214:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789545584.491221:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:3313:x1876474454882432:12345-0@lo:103: 00000100:00100000:2.0:1789545584.491229:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:3312:x1876474454882304:12345-0@lo:103: Request processed in 1323us (5194us total) trans 0 rc 0/0 00010000:00010000:0.0:1789545584.491229:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789545584.491234:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bc0031400/0x64919c0f856c041d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c0416 expref: 14 pid: 5840 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545584.491235:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789545584.491243:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bc0031400/0x64919c0f856c041d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c0416 expref: 13 pid: 5840 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.491254:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc0031400/0x64919c0f856c041d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c0416 expref: 13 pid: 5840 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.491266:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff994c0217f400/0x64919c0f856c04cc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.491275:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994c0217f400/0x64919c0f856c04cc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.491300:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994c0217f400/0x64919c0f856c04cc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.491306:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994c0217f400/0x64919c0f856c04cc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.491312:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff994c0217f400/0x64919c0f856c04cc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.491318:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff994c0217f400/0x64919c0f856c04cc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.491323:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217f400 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:0.0:1789545584.491327:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff994c0217f400/0x64919c0f856c04cc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.491334:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff994c0217f400/0x64919c0f856c04cc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.491355:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff994c0217f400/0x64919c0f856c04cc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.491389:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789545584.491422:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:3313:x1876474454882432:12345-0@lo:103: Request processed in 202us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545584.491428:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789545584.491454:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beb86ab1-4563-44b1-afd1-f08a43b0622e:3313:1876474454882432:0@lo:103: 00000100:00100000:0.0:1789545584.491482:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454882176:0@lo:103: 00000100:00100000:0.0:1789545584.491490:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454882304:0@lo:103: 00010000:00010000:2.0:1789545584.491945:0:5840:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff994c0217f400/0x64919c0f856c04cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545584.492264:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff994c0217f400/0x64919c0f856c04cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545584.492272:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994c0217f400/0x64919c0f856c04cc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789545584.492288:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789545584.547689:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+11:7629:x1876474454881152:12345-0@lo:253: Request processed in 79748us (79977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545584.547705:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789545584.547796:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454881152:0@lo:253: 10000000:01000000:0.0:1789545584.547814:0:7629:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789545584.547818:0:7629:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789545584.547819:0:7629:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789545584.547821:0:7629:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789545584.547822:0:7629:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1789545584.547824:0:7629:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789545584.547826:0:7629:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789545584.547827:0:7629:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789545584.547829:0:7629:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789545584.547830:0:7629:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789545584.547832:0:7629:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789545584.547855:0:7629:0:(tgt_mount.c:101:server_register_mount()) register mount ffff994bdfb06800 from lustre-OST0001 10000000:01000000:0.0:1789545584.547890:0:7629:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789545584.547894:0:7629:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789545584.547902:0:7629:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff994bc65dcd40 local copy 10000000:01000000:0.0:1789545584.547906:0:7629:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789545584.547946:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0031400/0x64919c0f856c04d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.547958:0:7629:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.116@tcp lock: ffff994bc0031400/0x64919c0f856c04d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.547967:0:7629:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc0031400/0x64919c0f856c04d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545584.547986:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454882560:0@lo:101: 00000100:00100000:0.0:1789545584.548022:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545584.548179:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bedd1acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789545584.548243:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454882560 00000100:00100000:2.0:1789545584.548249:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454882560 00000100:00100000:2.0:1789545584.548333:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789545584.548343:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+11:7629:x1876474454882560:12345-0@lo:101: 00010000:00010000:2.0:1789545584.548356:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545584.548410:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc49d1400/0x64919c0f856c04da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c04d3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545584.548432:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc49d1400/0x64919c0f856c04da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c04d3 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545584.548442:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc49d1400/0x64919c0f856c04da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c04d3 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545584.548450:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1400, rc 0) 00000100:00100000:2.0:1789545584.548495:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:7629:x1876474454882560:12345-0@lo:101: Request processed in 154us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545584.548501:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789545584.548563:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454882560:0@lo:101: 00010000:00010000:0.0:1789545584.548577:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc0031400/0x64919c0f856c04d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x64919c0f856c04da expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.548593:0:7629:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc0031400/0x64919c0f856c04d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x64919c0f856c04da expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545584.548695:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454882688:0@lo:501: 00000100:00100000:0.0:1789545584.548721:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545584.548922:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bedd1acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789545584.548992:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454882688 00000100:00100000:1.0:1789545584.548997:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454882688 00000100:00100000:1.0:1789545584.549022:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789545584.549030:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:7629:x1876474454882688:12345-0@lo:501: 00000100:00100000:1.0:1789545584.549317:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:7629:x1876474454882688:12345-0@lo:501: Request processed in 287us (594us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789545584.549325:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789545584.549649:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454882688:0@lo:501: 10000000:01000000:0.0:1789545584.549666:0:7629:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789545584.549697:0:7629:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789545584.549704:0:7629:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0031400/0x64919c0f856c04d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x64919c0f856c04da expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.549712:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0031400/0x64919c0f856c04d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x64919c0f856c04da expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.549720:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.116@tcp lock: ffff994bc0031400/0x64919c0f856c04d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x64919c0f856c04da expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.549781:0:7629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789545584.549803:0:7629:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff994bdfb06800 10000000:01000000:0.0:1789545584.549808:0:7629:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789545584.549813:0:7629:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789545584.549828:0:7629:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789545584.549832:0:7629:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789545584.549835:0:7629:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789545584.549854:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c04e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.549872:0:7629:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c04e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.549892:0:7629:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c04e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545584.549908:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454882816:0@lo:101: 00000100:00100000:0.0:1789545584.549939:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545584.549970:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bedd1a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789545584.550021:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454882816 00000100:00100000:2.0:1789545584.550026:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454882816 00000100:00100000:0.0:1789545584.550138:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789545584.550147:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:7629:x1876474454882816:12345-0@lo:101: 00010000:00010000:0.0:1789545584.550157:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545584.550167:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc0030000/0x64919c0f856c04e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c04e1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.550184:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc0030000/0x64919c0f856c04e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c04e1 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.550193:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc0030000/0x64919c0f856c04e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c04e1 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545584.550200:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc0030000, rc 0) 00000100:00100000:0.0:1789545584.550240:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:7629:x1876474454882816:12345-0@lo:101: Request processed in 95us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545584.550246:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789545584.550343:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454882816:0@lo:101: 00010000:00010000:3.0:1789545584.550355:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c04e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c04e8 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.550392:0:7629:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c04e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c04e8 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545584.550455:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454882944:0@lo:501: 00000100:00100000:2.0:1789545584.550663:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545584.550692:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bedd78300 going to sleep for 11 seconds 00000100:00100000:3.0:1789545584.550736:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454882944 00000100:00100000:3.0:1789545584.550740:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454882944 00000100:00100000:3.0:1789545584.550768:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789545584.550775:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:7629:x1876474454882944:12345-0@lo:501: 00000100:00100000:3.0:1789545584.550992:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:7629:x1876474454882944:12345-0@lo:501: Request processed in 216us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545584.550998:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789545584.551171:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454882944:0@lo:501: 00000100:00100000:2.0:1789545584.551199:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454883072:0@lo:503: 00000100:00100000:2.0:1789545584.551239:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545584.551261:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc8259780 going to sleep for 11 seconds 00000100:00100000:3.0:1789545584.551312:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454883072 00000100:00100000:3.0:1789545584.551317:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454883072 00000100:00100000:3.0:1789545584.551346:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789545584.551352:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:7629:x1876474454883072:12345-0@lo:503: 00000100:00100000:3.0:1789545584.551645:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:7629:x1876474454883072:12345-0@lo:503: Request processed in 293us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545584.551652:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00010000:1.0:1789545584.551730:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789545584.551738:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bc0031400/0x64919c0f856c04d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x64919c0f856c04da expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545584.551745:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc0031400 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:1.0:1789545584.551750:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bc0031400/0x64919c0f856c04d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x64919c0f856c04da expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545584.551758:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bc0031400/0x64919c0f856c04d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x64919c0f856c04da expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789545584.551772:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bc0031400/0x64919c0f856c04d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x64919c0f856c04da expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789545584.551776:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789545584.551838:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454883072:0@lo:503: 00000040:00080000:2.0:1789545584.552186:0:7629:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789545584.552246:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454883200:0@lo:502: 00000100:00100000:2.0:1789545584.552284:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545584.552395:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc4edfa80 going to sleep for 11 seconds 00010000:00010000:2.0:1789545584.552421:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bc0031400/0x64919c0f856c04d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x64919c0f856c04da expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545584.552437:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789545584.552550:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789545584.552560:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beb86ab1-4563-44b1-afd1-f08a43b0622e:3313:1876474454883328:0@lo:103: 00000100:00100000:3.0:1789545584.552586:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545584.552620:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454883328 00000100:00100000:3.0:1789545584.552626:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454883328 00000100:00100000:3.0:1789545584.552663:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789545584.552669:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc641f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:3313:x1876474454883328:12345-0@lo:103: 00010000:00010000:3.0:1789545584.552680:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545584.552694:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc49d1400/0x64919c0f856c04da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x64919c0f856c04d3 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.552709:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545584.552739:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc641f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:3313:x1876474454883328:12345-0@lo:103: Request processed in 69us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545584.552750:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789545584.552778:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beb86ab1-4563-44b1-afd1-f08a43b0622e:3313:1876474454883328:0@lo:103: 00010000:00010000:2.0:1789545584.552813:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bc0031400/0x64919c0f856c04d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x64919c0f856c04da expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545584.552821:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bc0031400/0x64919c0f856c04d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x64919c0f856c04da expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545584.552834:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545584.552836:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545584.552837:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545584.552931:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454883200 00000100:00100000:0.0:1789545584.552935:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454883200 00000100:00100000:0.0:1789545584.552991:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789545584.553003:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:7629:x1876474454883200:12345-0@lo:502: 00000100:00100000:0.0:1789545584.553187:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:7629:x1876474454883200:12345-0@lo:502: Request processed in 184us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545584.553194:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789545584.553260:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454883200:0@lo:502: 00000040:00080000:3.0:1789545584.553547:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789545584.553595:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789545584.553622:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789545584.553659:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789545584.553692:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789545584.553724:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789545584.553750:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454883456:0@lo:502: 00000100:00100000:3.0:1789545584.553787:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545584.554219:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bedd78f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789545584.554299:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454883456 00000100:00100000:2.0:1789545584.554305:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454883456 00000100:00100000:2.0:1789545584.554332:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789545584.554338:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:7629:x1876474454883456:12345-0@lo:502: 00000100:00100000:2.0:1789545584.554517:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:7629:x1876474454883456:12345-0@lo:502: Request processed in 178us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545584.554525:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789545584.554660:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454883456:0@lo:502: 00000040:00080000:3.0:1789545584.554753:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789545584.554762:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1789545584.555300:0:7640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789545584.555309:0:7640:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1789545584.555315:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789545584.555317:0:7640:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789545584.555324:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789545584.555338:0:7640:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff994be40ab380) 00000020:00000080:3.0:1789545584.555399:0:7640:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789545584.555407:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789545584.555527:0:7640:0:(tgt_mount.c:153:server_get_mount()) get mount ffff994bdfb06800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789545584.555537:0:7640:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789545584.555544:0:7640:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x64919c0f856c04f6 00010000:00010000:2.0:1789545584.559720:0:7640:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1789545584.560032:0:7640:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1789545584.563735:0:7640:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789545584.564043:0:7640:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1789545584.567326:0:7640:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1789545584.568791:0:7640:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1789545584.570026:0:7640:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789545584.570045:0:7640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789545584.570051:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789545584.570052:0:7640:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789545584.570459:0:7640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789545584.570613:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789545584.570616:0:7640:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789545584.570621:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789545584.570623:0:7640:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789545584.570670:0:7640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789545584.570674:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789545584.570675:0:7640:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789545584.570678:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789545584.570804:0:7629:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1789545584.570830:0:7629:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789545584.570854:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c04e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c04e8 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545584.570866:0:7629:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c04e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c04e8 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789545584.570891:0:7629:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994bdfb06800 from 1 10000000:01000000:2.0:1789545584.570894:0:7629:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789545584.570929:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d1800/0x64919c0f856c04fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545584.570938:0:7629:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc49d1800/0x64919c0f856c04fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545584.570949:0:7629:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc49d1800/0x64919c0f856c04fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545584.570971:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454883584:0@lo:101: 00000100:00100000:2.0:1789545584.571039:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545584.571159:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff994ac26f4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789545584.571258:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454883584 00000100:00100000:1.0:1789545584.571267:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454883584 00000100:00100000:1.0:1789545584.571317:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789545584.571328:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:7629:x1876474454883584:12345-0@lo:101: 00010000:00010000:1.0:1789545584.571340:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545584.571351:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bee11ba00/0x64919c0f856c0504 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c04fd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545584.571398:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bee11ba00/0x64919c0f856c0504 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c04fd expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545584.571408:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bee11ba00/0x64919c0f856c0504 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c04fd expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545584.571416:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bee11ba00, rc 0) 00000100:00100000:1.0:1789545584.571456:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:7629:x1876474454883584:12345-0@lo:101: Request processed in 131us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545584.571572:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454883584:0@lo:101: 00010000:00010000:3.0:1789545584.571585:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc49d1800/0x64919c0f856c04fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0504 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.571595:0:7629:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc49d1800/0x64919c0f856c04fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c0504 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545584.571677:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454883712:0@lo:501: 00000100:00100000:3.0:1789545584.571704:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545584.571725:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bedd78600 going to sleep for 11 seconds 00000100:00100000:1.0:1789545584.571758:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789545584.571783:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454883712 00000100:00100000:1.0:1789545584.571788:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454883712 00000100:00100000:1.0:1789545584.571801:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789545584.571807:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:7629:x1876474454883712:12345-0@lo:501: 00000100:00100000:1.0:1789545584.572029:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:7629:x1876474454883712:12345-0@lo:501: Request processed in 221us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545584.572044:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789545584.572183:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454883712:0@lo:501: 00000100:00100000:3.0:1789545584.572209:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454883840:0@lo:503: 00000100:00100000:3.0:1789545584.572243:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545584.572264:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bedd78600 going to sleep for 11 seconds 00000100:00100000:2.0:1789545584.572327:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454883840 00000100:00100000:2.0:1789545584.572332:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454883840 00000100:00100000:2.0:1789545584.572378:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789545584.572385:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:7629:x1876474454883840:12345-0@lo:503: 00000100:00100000:2.0:1789545584.572816:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:7629:x1876474454883840:12345-0@lo:503: Request processed in 430us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545584.572824:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789545584.572909:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454883840:0@lo:503: 00000040:00080000:3.0:1789545584.573279:0:7629:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789545584.573349:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454883968:0@lo:502: 00000100:00100000:3.0:1789545584.573429:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545584.573531:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bedd78600 going to sleep for 11 seconds 00000100:00100000:1.0:1789545584.573625:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454883968 00000100:00100000:1.0:1789545584.573632:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454883968 00000100:00100000:1.0:1789545584.573671:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789545584.573679:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:7629:x1876474454883968:12345-0@lo:502: 00000100:00100000:1.0:1789545584.573849:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:7629:x1876474454883968:12345-0@lo:502: Request processed in 171us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545584.573856:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789545584.573917:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454883968:0@lo:502: 00000040:00080000:1.0:1789545584.574270:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789545584.574320:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789545584.574348:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454884096:0@lo:502: 00000100:00100000:1.0:1789545584.574923:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545584.574994:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd1688780 going to sleep for 11 seconds 00000100:00100000:2.0:1789545584.579269:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454884096 00000100:00100000:2.0:1789545584.579284:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454884096 00000100:00100000:3.0:1789545584.579696:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789545584.579707:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:7629:x1876474454884096:12345-0@lo:502: 00000100:00100000:3.0:1789545584.579969:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:7629:x1876474454884096:12345-0@lo:502: Request processed in 263us (5047us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545584.579977:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789545584.582352:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454884096:0@lo:502: 00000040:00080000:1.0:1789545584.582744:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789545584.582760:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789545584.583321:0:7644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789545584.583331:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789545584.583333:0:7644:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789545584.583340:0:7644:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff994bdfb06800 00000020:00000080:3.0:1789545584.583343:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789545584.583559:0:7644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789545584.583563:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789545584.583565:0:7644:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789545584.583569:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789545584.583716:0:7629:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789545584.583737:0:7629:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789545584.583784:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d1800/0x64919c0f856c04fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0504 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545584.583796:0:7629:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc49d1800/0x64919c0f856c04fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0504 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789545584.583842:0:7629:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789545584.583845:0:7629:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff994bdfb06800 10000000:01000000:1.0:1789545584.583853:0:7629:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff994bdfb06800 10000000:01000000:1.0:1789545584.583857:0:7629:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789545584.583863:0:7629:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff994bdfb06800 from 1 10000000:01000000:1.0:1789545584.583866:0:7629:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789545584.583913:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bee11b000/0x64919c0f856c050b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545584.583922:0:7629:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bee11b000/0x64919c0f856c050b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545584.583933:0:7629:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bee11b000/0x64919c0f856c050b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545584.583954:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454884224:0@lo:101: 00000100:00100000:1.0:1789545584.584020:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545584.584158:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd1688240 going to sleep for 11 seconds 00000100:00100000:2.0:1789545584.584220:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454884224 00000100:00100000:2.0:1789545584.584228:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454884224 00000100:00100000:2.0:1789545584.584297:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789545584.584306:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:7629:x1876474454884224:12345-0@lo:101: 00010000:00010000:2.0:1789545584.584317:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545584.584334:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc49d1400/0x64919c0f856c0512 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c050b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545584.584355:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc49d1400/0x64919c0f856c0512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c050b expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545584.584452:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc49d1400/0x64919c0f856c0512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c050b expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545584.584524:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1400, rc 0) 00000100:00100000:2.0:1789545584.584609:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:7629:x1876474454884224:12345-0@lo:101: Request processed in 303us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545584.584617:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789545584.584709:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454884224:0@lo:101: 00010000:00010000:1.0:1789545584.584724:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bee11b000/0x64919c0f856c050b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0512 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545584.584732:0:7629:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bee11b000/0x64919c0f856c050b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c0512 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545584.584816:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454884352:0@lo:501: 00000100:00100000:1.0:1789545584.584842:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545584.584873:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd1688240 going to sleep for 11 seconds 00000100:00100000:0.0:1789545584.584933:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454884352 00000100:00100000:0.0:1789545584.584938:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454884352 00000100:00100000:0.0:1789545584.584997:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789545584.585005:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8dde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:7629:x1876474454884352:12345-0@lo:501: 00000100:00100000:0.0:1789545584.585286:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8dde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:7629:x1876474454884352:12345-0@lo:501: Request processed in 281us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545584.585294:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789545584.585390:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454884352:0@lo:501: 00000100:00100000:1.0:1789545584.585417:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454884480:0@lo:503: 00000100:00100000:1.0:1789545584.585455:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545584.585587:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd1688240 going to sleep for 11 seconds 00000100:00100000:0.0:1789545584.585628:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454884480 00000100:00100000:0.0:1789545584.585632:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454884480 00000100:00100000:0.0:1789545584.585650:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789545584.585655:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:7629:x1876474454884480:12345-0@lo:503: 00000100:00100000:0.0:1789545584.585791:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:7629:x1876474454884480:12345-0@lo:503: Request processed in 136us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545584.585798:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789545584.585870:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454884480:0@lo:503: 00000040:00080000:1.0:1789545584.586194:0:7629:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789545584.586260:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454884608:0@lo:502: 00000100:00100000:1.0:1789545584.586293:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545584.586325:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd1688240 going to sleep for 11 seconds 00000100:00100000:2.0:1789545584.586529:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454884608 00000100:00100000:2.0:1789545584.586534:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454884608 00000100:00100000:2.0:1789545584.586555:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789545584.586561:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:7629:x1876474454884608:12345-0@lo:502: 00000100:00100000:2.0:1789545584.586708:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:7629:x1876474454884608:12345-0@lo:502: Request processed in 147us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545584.586714:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789545584.587025:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454884608:0@lo:502: 00000040:00080000:1.0:1789545584.587316:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789545584.587610:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789545584.587723:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789545584.587770:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789545584.587798:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789545584.587834:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789545584.587862:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789545584.587902:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789545584.587943:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789545584.587974:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789545584.588002:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789545584.588038:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789545584.588143:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789545584.588184:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789545584.588224:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789545584.588251:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789545584.588277:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789545584.588313:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789545584.588340:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789545584.589133:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789545584.589194:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789545584.589223:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789545584.589249:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789545584.589285:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789545584.589313:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1789545584.589338:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1789545584.589396:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1789545584.589426:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1789545584.589451:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1789545584.589616:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1789545584.589649:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1789545584.589675:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1789545584.589701:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1789545584.589737:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1789545584.589764:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1789545584.589800:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1789545584.589826:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1789545584.589867:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454884736:0@lo:502: 00000100:00100000:0.0:1789545584.589955:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545584.589999:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bedd1ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789545584.590127:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454884736 00000100:00100000:2.0:1789545584.590135:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454884736 00000100:00100000:2.0:1789545584.590184:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789545584.590193:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:7629:x1876474454884736:12345-0@lo:502: 00000100:00100000:2.0:1789545584.590546:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:7629:x1876474454884736:12345-0@lo:502: Request processed in 353us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545584.590553:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789545584.590759:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454884736:0@lo:502: 00000040:00080000:1.0:1789545584.590831:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1789545584.590841:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1789545584.591569:0:7645:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789545584.591585:0:7645:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff994be40a8000) 00000020:00000080:3.0:1789545584.591609:0:7645:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1789545584.591671:0:7645:0:(tgt_mount.c:153:server_get_mount()) get mount ffff994bdfb06800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789545584.591674:0:7645:0:(tgt_mount.c:187:server_put_mount()) put mount ffff994bdfb06800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789545584.591676:0:7645:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994bdfb06800 3 00010000:00080000:3.0:1789545584.591702:0:7645:0:(ldlm_lib.c:102:import_set_conn()) imp ffff994be5050000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.116@tcp at head 00010000:00010000:3.0:1789545584.593664:0:7645:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1789545584.593954:0:7645:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789545584.593994:0:7645:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789545584.594008:0:7645:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x64919c0f856c0520 00000100:00080000:3.0:1789545584.594020:0:7645:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789545584.594038:0:7645:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff994be5050000 using connection 192.168.201.116@tcp/0@lo 00000100:00100000:3.0:1789545584.594098:0:7645:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994bc641d880 x1876474454884864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789545584.594125:0:7645:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789545584.594309:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1876474454884864:0@lo:38: 00000100:00100000:1.0:1789545584.594407:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545584.594584:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454884864 00000100:00100000:3.0:1789545584.594592:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454884864 00000100:00100000:3.0:1789545584.594629:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789545584.594637:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1876474454884864:12345-0@lo:38: 00010000:00080000:3.0:1789545584.594659:0:5846:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:3.0:1789545584.594690:0:5846:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x64919c0f856c0527 00000004:00100000:3.0:1789545584.594706:0:5846:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789545584.594761:0:5846:0:(import.c:65:import_set_state_nolock()) ffff994be4c9b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789545584.594820:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876474454884864:12345-0@lo:38: Request processed in 182us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545584.594827:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789545584.595046:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876474454885120:0@lo:400: 00000100:00100000:0.0:1789545584.595089:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545584.595112:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789545584.595126:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876474454884992:0@lo:400: 00000100:00100000:0.0:1789545584.595149:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545584.595174:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454885248:0@lo:400: 00000100:00100000:0.0:1789545584.595202:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545584.595232:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454885248 00000100:00100000:0.0:1789545584.595237:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454885248 00000100:00100000:0.0:1789545584.595276:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789545584.595283:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454885248:12345-0@lo:400: 00000100:00100000:0.0:1789545584.595320:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454885248:12345-0@lo:400: Request processed in 37us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545584.595325:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789545584.595387:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994be54c6a00 x1876474454885248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545584.595401:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454885248:0@lo:400: 00000100:00100000:0.0:1789545584.595420:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454885120 00000100:00100000:0.0:1789545584.595423:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454885120 00000100:00100000:0.0:1789545584.595440:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454884992 00000100:00100000:0.0:1789545584.595443:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454884992 00000100:00100000:0.0:1789545584.595455:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789545584.595534:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876474454885120:12345-0@lo:400: 00000100:00100000:0.0:1789545584.595573:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876474454885120:12345-0@lo:400: Request processed in 112us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545584.595579:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789545584.595591:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789545584.595596:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876474454884992:12345-0@lo:400: 00000100:00100000:0.0:1789545584.595622:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876474454884992:12345-0@lo:400: Request processed in 26us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545584.595637:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789545584.595662:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994be54c5880 x1876474454884992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545584.595672:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876474454884992:0@lo:400: 00010000:00080000:0.0:1789545584.595681:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994be54c6680 x1876474454885120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545584.595688:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876474454885120:0@lo:400: 00000100:00080000:1.0:1789545584.595854:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789545584.595859:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789545584.595893:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994bc641d880 x1876474454884864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789545594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545584.595903:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789545584.595910:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1789545584.595918:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789545584.595923:0:3310:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789545584.595925:0:3310:0:(import.c:65:import_set_state_nolock()) ffff994be5050000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789545584.595932:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1876474454884864:0@lo:38: 00000040:00080000:3.0:1789545584.596698:0:7645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1789545584.596933:0:7646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c6680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7646:1876474454885376:0@lo:901: 00000100:00100000:0.0:1789545584.596983:0:7646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545584.597017:0:7646:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bedd1a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789545584.597076:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454885376 00000100:00100000:3.0:1789545584.597083:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454885376 00000100:00100000:3.0:1789545584.597131:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789545584.597139:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7646:x1876474454885376:12345-0@lo:901: 00000100:00080000:0.0:1789545584.597550:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789545584.597575:0:7646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994be54c6680 x1876474454885376/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789545600 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545584.597587:0:7646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c6680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7646:1876474454885376:0@lo:901: 00000100:00100000:3.0:1789545584.597731:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7646:x1876474454885376:12345-0@lo:901: Request processed in 593us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545584.597739:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:1.0:1789545584.598646:0:7629:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1789545584.598689:0:7629:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789545584.598710:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bee11b000/0x64919c0f856c050b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0512 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545584.598720:0:7629:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bee11b000/0x64919c0f856c050b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0512 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789545584.598765:0:7629:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789545584.598767:0:7629:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789545584.598769:0:7629:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789545584.598770:0:7629:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789545584.598771:0:7629:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789545584.598773:0:7629:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789545584.598774:0:7629:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789545584.598776:0:7629:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789545584.598777:0:7629:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789545584.598779:0:7629:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789545584.598780:0:7629:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789545584.598784:0:7629:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1789545584.598786:0:7629:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789545584.598788:0:7629:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789545584.598789:0:7629:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789545584.598790:0:7629:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789545584.598792:0:7629:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789545584.598793:0:7629:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789545584.598794:0:7629:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789545584.598795:0:7629:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789545584.598796:0:7629:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789545584.598797:0:7629:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789545584.598798:0:7629:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789545584.598818:0:7629:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789545584.598833:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d9bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454885504:0@lo:253: 00000100:00100000:1.0:1789545584.598974:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545584.599011:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454885504 00000100:00100000:1.0:1789545584.599017:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454885504 00000100:00100000:1.0:1789545584.599550:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789545584.599569:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:7629:x1876474454885504:12345-0@lo:253: 20000000:01000000:1.0:1789545584.599607:0:5840:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789545584.599621:0:5840:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789545584.600077:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd1688780 going to sleep for 11 seconds 20000000:01000000:1.0:1789545584.630753:0:5840:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789545584.630771:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789545584.631390:0:5862:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789545584.631397:0:5862:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789545584.631431:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff994bc49d0200/0x64919c0f856c052e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545584.631450:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bee11aa00/0x64919c0f856c047f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0478 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545584.631547:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff994bc49d0200/0x64919c0f856c052e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545584.631589:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bee11aa00/0x64919c0f856c047f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c0478 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545584.631604:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994bee11aa00/0x64919c0f856c047f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c0478 expref: 14 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545584.631619:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d1180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5862:1876474454885632:0@lo:104: 00000100:00100000:2.0:1789545584.631679:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545584.631732:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc611ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1789545584.631785:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454885632 00000100:00100000:3.0:1789545584.631793:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454885632 00000100:00100000:3.0:1789545584.631846:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789545584.631855:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+3:5862:x1876474454885632:12345-0@lo:104: 00010000:00010000:3.0:1789545584.631868:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994bc0031600/0x64919c0f856c0478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c047f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.631941:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789545584.631948:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+3:5862:x1876474454885632:12345-0@lo:104: Request processed in 94us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545584.631955:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1789545584.631976:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789545584.631982:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bc0031600/0x64919c0f856c0478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c047f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.631989:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc0031600 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:3.0:1789545584.631993:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bc0031600/0x64919c0f856c0478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c047f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.632002:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bc0031600/0x64919c0f856c0478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c047f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789545584.632009:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bc0031600/0x64919c0f856c0478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c047f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789545584.632015:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789545584.632040:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bc0031600/0x64919c0f856c0478 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c047f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.632047:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789545584.632138:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bc0031600/0x64919c0f856c0478 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c047f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.632145:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bc0031600/0x64919c0f856c0478 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c047f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.632172:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545584.632173:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545584.632175:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789545584.632183:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789545584.632194:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beb86ab1-4563-44b1-afd1-f08a43b0622e:3313:1876474454885760:0@lo:103: 00000100:00100000:3.0:1789545584.632224:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545584.632254:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454885760 00000100:00100000:3.0:1789545584.632258:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454885760 00010000:00010000:3.0:1789545584.632275:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bee11aa00/0x64919c0f856c047f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c0478 expref: 15 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545584.632296:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789545584.632303:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd9367850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:3313:x1876474454885760:12345-0@lo:103: 00010000:00010000:3.0:1789545584.632314:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545584.632319:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bee11aa00/0x64919c0f856c047f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c0478 expref: 15 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.632328:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bee11aa00/0x64919c0f856c047f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c0478 expref: 15 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.632344:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff994bc49d0200/0x64919c0f856c052e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.632351:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc49d0200/0x64919c0f856c052e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789545584.632390:0:7636:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003458178s 00010000:00010000:3.0:1789545584.632395:0:7636:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994bc49d0200/0x64919c0f856c052e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.632411:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994bc49d0200/0x64919c0f856c052e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.632418:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff994bc49d0200/0x64919c0f856c052e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.632423:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff994bc49d0200/0x64919c0f856c052e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.632428:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0200 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545584.632432:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff994bc49d0200/0x64919c0f856c052e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.632439:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff994bc49d0200/0x64919c0f856c052e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.632447:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff994bc49d0200/0x64919c0f856c052e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545584.632456:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545584.632566:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd9367850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:3313:x1876474454885760:12345-0@lo:103: Request processed in 263us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545584.632572:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789545584.632633:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beb86ab1-4563-44b1-afd1-f08a43b0622e:3313:1876474454885760:0@lo:103: 00010000:00010000:2.0:1789545584.633698:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bee11aa00/0x64919c0f856c047f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c0478 expref: 14 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545584.633713:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d1180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5862:1876474454885632:0@lo:104: 00010000:00010000:2.0:1789545584.633732:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff994bc49d0200/0x64919c0f856c052e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545584.633741:0:5862:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff994bc49d0200/0x64919c0f856c052e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545584.633748:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff994bc49d0200/0x64919c0f856c052e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545584.633769:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc49d0200/0x64919c0f856c052e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545584.640409:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:7629:x1876474454885504:12345-0@lo:253: Request processed in 40832us (41423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545584.640424:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789545584.640597:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d9bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:beb86ab1-4563-44b1-afd1-f08a43b0622e:7629:1876474454885504:0@lo:253: 10000000:01000000:2.0:1789545584.640612:0:7629:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789545584.640616:0:7629:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789545584.640618:0:7629:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789545584.640619:0:7629:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789545584.640620:0:7629:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789545584.640622:0:7629:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789545584.640623:0:7629:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789545584.640624:0:7629:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789545584.640626:0:7629:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789545584.640627:0:7629:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789545584.640628:0:7629:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789545584.640630:0:7629:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789545584.640646:0:7629:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789545584.645022:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789545584.645315:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789545584.645638:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789545584.645801:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789545584.646000:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789545584.646848:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789545584.648274:0:7629:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789545584.868316:0:7629:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789545584.868324:0:7629:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789545584.868383:0:7629:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789545584.868440:0:7629:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.116@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789545584.868454:0:7629:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789545584.868741:0:7629:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1789545585.469770:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545585.725153:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789545585.725179:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454885888:0@lo:13: 00000100:00100000:1.0:1789545585.725246:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545585.725303:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454885888 00000100:00100000:1.0:1789545585.725310:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454885888 00000100:00100000:1.0:1789545585.725350:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789545585.725378:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454885888:12345-0@lo:13: 00002000:00000024:1.0:1789545585.725410:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789545585.725449:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454885888:12345-0@lo:13: Request processed in 92us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545585.725456:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789545585.725493:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bd8d99880 x1876474454885888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545601 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545585.725510:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454885888:0@lo:13: 00010000:00010000:3.0:1789545586.492799:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545587.518505:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545588.542507:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545589.564619:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545589.824402:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454886400:0@lo:400: 00000100:00100000:2.0:1789545589.824476:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545589.824581:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454886016:0@lo:400: 00000100:00100000:0.0:1789545589.824622:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545589.829636:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454886144:0@lo:400: 00000100:00100000:3.0:1789545589.829697:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545589.831111:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454886016 00000100:00100000:0.0:1789545589.831125:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454886016 00000100:00100000:0.0:1789545589.831180:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789545589.831190:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:3312:x1876474454886016:12345-0@lo:400: 00000100:00100000:0.0:1789545589.831263:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:3312:x1876474454886016:12345-0@lo:400: Request processed in 74us (6639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545589.831280:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789545589.831319:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454886144 00000100:00100000:0.0:1789545589.831323:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454886144 00000100:00100000:0.0:1789545589.831353:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789545589.831377:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc641ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454886144:12345-0@lo:400: 00000100:00100000:0.0:1789545589.831411:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc641ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454886144:12345-0@lo:400: Request processed in 51us (1712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545589.831416:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789545589.833054:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876474454886272:0@lo:400: 00000100:00100000:2.0:1789545589.833112:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545589.833635:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454886400 00000100:00100000:2.0:1789545589.833642:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454886400 00000100:00100000:2.0:1789545589.833681:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789545589.833687:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454886400:12345-0@lo:400: 00000100:00100000:2.0:1789545589.833730:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454886400:12345-0@lo:400: Request processed in 43us (9255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545589.833961:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789545589.833989:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454886272 00000100:00100000:2.0:1789545589.833993:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454886272 00000100:00100000:2.0:1789545589.834015:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789545589.834019:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876474454886272:12345-0@lo:400: 00000100:00100000:2.0:1789545589.834045:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876474454886272:12345-0@lo:400: Request processed in 26us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545589.834049:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1789545589.834059:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789545589.834063:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789545589.834087:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be54d2a00 x1876474454886272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545589.834099:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876474454886272:0@lo:400: 00010000:00080000:2.0:1789545589.834118:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be54d0700 x1876474454886400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545589.834124:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454886400:0@lo:400: 00000100:00100000:2.0:1789545589.834146:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454886016:0@lo:400: 00000100:00100000:2.0:1789545589.834152:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454886528:0@lo:400: 00000100:00100000:2.0:1789545589.834173:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545589.834195:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454886528 00000100:00100000:2.0:1789545589.834205:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454886528 00000100:00100000:2.0:1789545589.834223:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789545589.834226:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454886528:12345-0@lo:400: 00000100:00100000:2.0:1789545589.834249:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454886528:12345-0@lo:400: Request processed in 23us (75us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545589.834253:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1789545589.834260:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789545589.834270:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be54d2d80 x1876474454886528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545589.834276:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454886528:0@lo:400: 00010000:00080000:3.0:1789545589.835482:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be54d0e00 x1876474454886144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545589.835502:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454886144:0@lo:400: 10000000:01000000:0.0:1789545590.333152:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789545590.333159:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff994bc8231800 from 30 10000000:01000000:0.0:1789545590.333163:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789545590.333207:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0031800/0x64919c0f856c0535 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545590.333219:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc0031800/0x64919c0f856c0535 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545590.333231:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc0031800/0x64919c0f856c0535 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545590.333256:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454886656:0@lo:101: 00000100:00100000:0.0:1789545590.333328:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545590.333419:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994ac2b53240 going to sleep for 11 seconds 00000100:00100000:2.0:1789545590.337946:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454886656 00000100:00100000:2.0:1789545590.337961:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454886656 00000100:00100000:2.0:1789545590.338026:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789545590.338037:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:5843:x1876474454886656:12345-0@lo:101: 00010000:00010000:2.0:1789545590.338054:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545590.338076:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc49d0400/0x64919c0f856c053c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c0535 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545590.338105:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc49d0400/0x64919c0f856c053c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c0535 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545590.338117:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc49d0400/0x64919c0f856c053c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0535 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545590.338127:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0400, rc 0) 00000100:00100000:2.0:1789545590.338204:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:5843:x1876474454886656:12345-0@lo:101: Request processed in 169us (4876us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545590.338210:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789545590.338277:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454886656:0@lo:101: 00010000:00010000:2.0:1789545590.338297:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc0031800/0x64919c0f856c0535 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c053c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545590.338307:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc0031800/0x64919c0f856c0535 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c053c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545590.338401:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454886784:0@lo:501: 00000100:00100000:2.0:1789545590.338438:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545590.338467:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994be4e76d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789545590.338480:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454886784 00000100:00100000:2.0:1789545590.338484:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454886784 00000100:00100000:2.0:1789545590.338505:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789545590.338512:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:5843:x1876474454886784:12345-0@lo:501: 00000100:00100000:2.0:1789545590.339105:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:5843:x1876474454886784:12345-0@lo:501: Request processed in 590us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545590.339113:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789545590.339163:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454886784:0@lo:501: 00000100:00100000:2.0:1789545590.339201:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454886912:0@lo:503: 00000100:00100000:2.0:1789545590.339242:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545590.339259:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994be4e76d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789545590.339272:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454886912 00000100:00100000:2.0:1789545590.339277:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454886912 00000100:00100000:2.0:1789545590.339304:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789545590.339313:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:5843:x1876474454886912:12345-0@lo:503: 00000100:00100000:2.0:1789545590.339615:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:5843:x1876474454886912:12345-0@lo:503: Request processed in 302us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545590.339630:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789545590.339668:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454886912:0@lo:503: 00000100:00100000:1.0:1789545590.341532:0:7955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d99880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:7955:1876474454887040:0@lo:502: 00000100:00100000:1.0:1789545590.341606:0:7955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545590.341635:0:7955:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc8bab0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789545590.341707:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454887040 00000100:00100000:2.0:1789545590.341715:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454887040 00000100:00100000:2.0:1789545590.341761:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789545590.341944:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:7955:x1876474454887040:12345-0@lo:502: 00000100:00100000:2.0:1789545590.342265:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:7955:x1876474454887040:12345-0@lo:502: Request processed in 325us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545590.342272:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789545590.342498:0:7955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d99880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:7955:1876474454887040:0@lo:502: 00000100:00100000:1.0:1789545590.342554:0:7955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d99880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:7955:1876474454887168:0@lo:502: 00000100:00100000:1.0:1789545590.342589:0:7955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545590.342609:0:7955:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc8bab0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789545590.342662:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454887168 00000100:00100000:2.0:1789545590.342667:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454887168 00000100:00100000:2.0:1789545590.342857:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789545590.342866:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:7955:x1876474454887168:12345-0@lo:502: 00000100:00100000:2.0:1789545590.343041:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:7955:x1876474454887168:12345-0@lo:502: Request processed in 176us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545590.343048:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789545590.347049:0:7955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d99880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:7955:1876474454887168:0@lo:502: 00000040:00080000:1.0:1789545590.347103:0:7955:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789545590.348254:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789545590.348289:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789545590.348301:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0031800/0x64919c0f856c0535 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c053c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545590.348314:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc0031800/0x64919c0f856c0535 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c053c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789545590.348325:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789545590.348327:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1789545590.348330:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789545590.348428:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d0e00/0x64919c0f856c0543 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545590.348437:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc49d0e00/0x64919c0f856c0543 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545590.348447:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc49d0e00/0x64919c0f856c0543 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545590.348469:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454887296:0@lo:101: 00000100:00100000:2.0:1789545590.348533:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545590.348574:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994be4e76000 going to sleep for 11 seconds 00000100:00100000:1.0:1789545590.348724:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454887296 00000100:00100000:1.0:1789545590.348733:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454887296 00000100:00100000:1.0:1789545590.348800:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789545590.348810:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:5843:x1876474454887296:12345-0@lo:101: 00010000:00010000:1.0:1789545590.348823:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545590.348836:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bee11be00/0x64919c0f856c054a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c0543 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545590.348858:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bee11be00/0x64919c0f856c054a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c0543 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545590.348868:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bee11be00/0x64919c0f856c054a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0543 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545590.348877:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bee11be00, rc 0) 00000100:00100000:1.0:1789545590.348922:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:5843:x1876474454887296:12345-0@lo:101: Request processed in 114us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545590.348930:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789545590.348973:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454887296:0@lo:101: 00010000:00010000:1.0:1789545590.348988:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc49d0e00/0x64919c0f856c0543 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c054a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545590.349009:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc49d0e00/0x64919c0f856c0543 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c054a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545590.349061:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454887424:0@lo:501: 00000100:00100000:1.0:1789545590.349087:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545590.349101:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc8baba80 going to sleep for 11 seconds 00000100:00100000:1.0:1789545590.349112:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454887424 00000100:00100000:1.0:1789545590.349116:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454887424 00000100:00100000:1.0:1789545590.349133:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789545590.349138:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:5843:x1876474454887424:12345-0@lo:501: 00000100:00100000:1.0:1789545590.349421:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:5843:x1876474454887424:12345-0@lo:501: Request processed in 282us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545590.349428:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789545590.349460:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454887424:0@lo:501: 00000100:00100000:1.0:1789545590.349487:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454887552:0@lo:503: 00000100:00100000:1.0:1789545590.349522:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545590.349535:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bfbfc3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789545590.349546:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454887552 00000100:00100000:1.0:1789545590.349549:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454887552 00000100:00100000:1.0:1789545590.349564:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789545590.349570:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:5843:x1876474454887552:12345-0@lo:503: 00000100:00100000:1.0:1789545590.349848:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:5843:x1876474454887552:12345-0@lo:503: Request processed in 277us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545590.349855:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789545590.349891:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454887552:0@lo:503: 00000100:00100000:1.0:1789545590.350062:0:7957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d99880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:7957:1876474454887680:0@lo:502: 00000100:00100000:1.0:1789545590.350097:0:7957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545590.350116:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454887680 00000100:00100000:1.0:1789545590.350120:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454887680 00000100:00100000:1.0:1789545590.350138:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789545590.350144:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:7957:x1876474454887680:12345-0@lo:502: 00000100:00100000:1.0:1789545590.350276:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:7957:x1876474454887680:12345-0@lo:502: Request processed in 132us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545590.350283:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789545590.350307:0:7957:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bfbfc3900 going to sleep for 11 seconds 00000100:00100000:1.0:1789545590.350318:0:7957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d99880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:7957:1876474454887680:0@lo:502: 00000020:01000000:1.0:1789545590.350339:0:7957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789545590.350348:0:7957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789545590.350350:0:7957:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789545590.350355:0:7957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789545590.350380:0:7957:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789545590.350397:0:7957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d99880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:7957:1876474454887808:0@lo:502: 00000100:00100000:1.0:1789545590.350429:0:7957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545590.350447:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454887808 00000100:00100000:1.0:1789545590.350450:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454887808 00000100:00100000:1.0:1789545590.350465:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789545590.350470:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:7957:x1876474454887808:12345-0@lo:502: 00000100:00100000:1.0:1789545590.350564:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:7957:x1876474454887808:12345-0@lo:502: Request processed in 93us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545590.350570:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789545590.350594:0:7957:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd938c900 going to sleep for 11 seconds 00000100:00100000:1.0:1789545590.350603:0:7957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d99880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:7957:1876474454887808:0@lo:502: 00000020:01000000:1.0:1789545590.350623:0:7957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789545590.350626:0:7957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789545590.350628:0:7957:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789545590.350631:0:7957:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1789545590.350667:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1789545590.350680:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789545590.350688:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d0e00/0x64919c0f856c0543 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c054a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545590.350698:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc49d0e00/0x64919c0f856c0543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c054a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789545590.350707:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789545590.350710:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff994bc4a49800 from 30 10000000:01000000:1.0:1789545590.350713:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789545590.350734:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bee11aa00/0x64919c0f856c0551 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545590.350742:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bee11aa00/0x64919c0f856c0551 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545590.350751:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bee11aa00/0x64919c0f856c0551 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545590.350762:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454887936:0@lo:101: 00000100:00100000:1.0:1789545590.350797:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545590.350812:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd938c900 going to sleep for 11 seconds 00000100:00100000:1.0:1789545590.350824:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454887936 00000100:00100000:1.0:1789545590.350827:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454887936 00000100:00100000:1.0:1789545590.350844:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789545590.350850:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:5843:x1876474454887936:12345-0@lo:101: 00010000:00010000:1.0:1789545590.350862:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545590.350873:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bee11ae00/0x64919c0f856c0558 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c0551 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545590.350891:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bee11ae00/0x64919c0f856c0558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c0551 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545590.350900:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bee11ae00/0x64919c0f856c0558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0551 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545590.350908:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bee11ae00, rc 0) 00000100:00100000:1.0:1789545590.350935:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:5843:x1876474454887936:12345-0@lo:101: Request processed in 85us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545590.350942:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789545590.350969:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454887936:0@lo:101: 00010000:00010000:1.0:1789545590.350980:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bee11aa00/0x64919c0f856c0551 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0558 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545590.350988:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bee11aa00/0x64919c0f856c0551 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c0558 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545590.351024:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454888064:0@lo:501: 00000100:00100000:1.0:1789545590.351046:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545590.351059:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd938c900 going to sleep for 11 seconds 00000100:00100000:1.0:1789545590.351069:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454888064 00000100:00100000:1.0:1789545590.351072:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454888064 00000100:00100000:1.0:1789545590.351087:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789545590.351092:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:5843:x1876474454888064:12345-0@lo:501: 00000100:00100000:1.0:1789545590.351282:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:5843:x1876474454888064:12345-0@lo:501: Request processed in 188us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545590.351289:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789545590.351314:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454888064:0@lo:501: 00000100:00100000:1.0:1789545590.351336:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454888192:0@lo:503: 00000100:00100000:1.0:1789545590.351394:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545590.351407:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd938c900 going to sleep for 11 seconds 00000100:00100000:1.0:1789545590.351418:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454888192 00000100:00100000:1.0:1789545590.351422:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454888192 00000100:00100000:1.0:1789545590.351437:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789545590.351443:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:5843:x1876474454888192:12345-0@lo:503: 00000100:00100000:1.0:1789545590.351562:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:5843:x1876474454888192:12345-0@lo:503: Request processed in 117us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545590.351568:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789545590.351602:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454888192:0@lo:503: 00000100:00100000:2.0:1789545590.357495:0:7958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:7958:1876474454888320:0@lo:502: 00000100:00100000:2.0:1789545590.357568:0:7958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545590.357600:0:7958:0:(client.c:2716:ptlrpc_set_wait()) set ffff994be4e76cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789545590.357645:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454888320 00000100:00100000:1.0:1789545590.357651:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454888320 00000100:00100000:1.0:1789545590.357690:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789545590.357699:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:7958:x1876474454888320:12345-0@lo:502: 00000100:00100000:1.0:1789545590.358470:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:7958:x1876474454888320:12345-0@lo:502: Request processed in 771us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545590.358477:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789545590.365652:0:7958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:7958:1876474454888320:0@lo:502: 00000100:00100000:3.0:1789545590.365771:0:7958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:7958:1876474454888448:0@lo:502: 00000100:00100000:3.0:1789545590.365863:0:7958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545590.365913:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454888448 00000100:00100000:3.0:1789545590.365920:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454888448 00000100:00100000:3.0:1789545590.365994:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789545590.366004:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:7958:x1876474454888448:12345-0@lo:502: 00000100:00100000:3.0:1789545590.366248:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:7958:x1876474454888448:12345-0@lo:502: Request processed in 245us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545590.366256:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789545590.366300:0:7958:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8e74300 going to sleep for 11 seconds 00000100:00100000:3.0:1789545590.366311:0:7958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:7958:1876474454888448:0@lo:502: 00000040:00080000:3.0:1789545590.366331:0:7958:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789545590.366746:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789545590.366766:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789545590.366777:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bee11aa00/0x64919c0f856c0551 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0558 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545590.366807:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bee11aa00/0x64919c0f856c0551 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0558 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789545590.366818:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789545590.366821:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff994bc4a49800 from 5 10000000:01000000:1.0:1789545590.366824:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789545590.366855:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bee11bc00/0x64919c0f856c055f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545590.366867:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bee11bc00/0x64919c0f856c055f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545590.366877:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bee11bc00/0x64919c0f856c055f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545590.366894:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454888576:0@lo:101: 00000100:00100000:1.0:1789545590.366926:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545590.367061:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd938c900 going to sleep for 11 seconds 00000100:00100000:3.0:1789545590.367125:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454888576 00000100:00100000:3.0:1789545590.367131:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454888576 00000100:00100000:3.0:1789545590.367164:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789545590.367171:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:5843:x1876474454888576:12345-0@lo:101: 00010000:00010000:3.0:1789545590.367180:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545590.367193:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994c0217ea00/0x64919c0f856c0566 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c055f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545590.367218:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994c0217ea00/0x64919c0f856c0566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c055f expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545590.367228:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994c0217ea00/0x64919c0f856c0566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c055f expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545590.367237:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217ea00, rc 0) 00000100:00100000:3.0:1789545590.367269:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:5843:x1876474454888576:12345-0@lo:101: Request processed in 99us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545590.367275:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789545590.367630:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454888576:0@lo:101: 00010000:00010000:1.0:1789545590.367646:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bee11bc00/0x64919c0f856c055f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0566 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545590.367654:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bee11bc00/0x64919c0f856c055f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c0566 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545590.367704:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454888704:0@lo:256: 00000100:00100000:1.0:1789545590.367737:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545590.367775:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd938c900 going to sleep for 11 seconds 00000100:00100000:3.0:1789545590.367970:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454888704 00000100:00100000:3.0:1789545590.367977:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454888704 00000100:00100000:3.0:1789545590.368250:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789545590.368259:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:5843:x1876474454888704:12345-0@lo:256: 20000000:01000000:3.0:1789545590.368274:0:5839:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789545590.368290:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789545590.368293:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1789545590.368408:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:5843:x1876474454888704:12345-0@lo:256: Request processed in 150us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545590.368414:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789545590.368555:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454888704:0@lo:256: 10000000:01000000:1.0:1789545590.368605:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789545590.368613:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bee11bc00/0x64919c0f856c055f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0566 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545590.368622:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bee11bc00/0x64919c0f856c055f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0566 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789545590.368630:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789545590.368633:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1789545590.368635:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789545590.368658:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bee11a000/0x64919c0f856c056d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545590.368667:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bee11a000/0x64919c0f856c056d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545590.368676:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bee11a000/0x64919c0f856c056d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545590.368690:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454888832:0@lo:101: 00000100:00100000:1.0:1789545590.368717:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545590.368743:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd938c900 going to sleep for 11 seconds 00000100:00100000:3.0:1789545590.368793:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454888832 00000100:00100000:3.0:1789545590.368798:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454888832 00000100:00100000:3.0:1789545590.368828:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789545590.368836:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:5843:x1876474454888832:12345-0@lo:101: 00010000:00010000:3.0:1789545590.368844:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545590.368855:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994c0217f800/0x64919c0f856c0574 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c056d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545590.368883:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994c0217f800/0x64919c0f856c0574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c056d expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545590.368893:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994c0217f800/0x64919c0f856c0574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c056d expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545590.368900:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217f800, rc 0) 00000100:00100000:3.0:1789545590.368929:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:5843:x1876474454888832:12345-0@lo:101: Request processed in 94us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545590.368935:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789545590.370693:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454888832:0@lo:101: 00010000:00010000:1.0:1789545590.370719:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bee11a000/0x64919c0f856c056d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0574 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545590.370731:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bee11a000/0x64919c0f856c056d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c0574 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545590.379122:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454888960:0@lo:501: 00000100:00100000:0.0:1789545590.379190:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545590.379229:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994ac2b53b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789545590.379252:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454888960 00000100:00100000:0.0:1789545590.379260:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454888960 00000100:00100000:0.0:1789545590.379310:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789545590.379320:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:5843:x1876474454888960:12345-0@lo:501: 00000100:00100000:0.0:1789545590.380269:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:5843:x1876474454888960:12345-0@lo:501: Request processed in 946us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545590.380279:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789545590.380343:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454888960:0@lo:501: 00000100:00100000:0.0:1789545590.380431:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454889088:0@lo:503: 00000100:00100000:0.0:1789545590.380473:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545590.380498:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994ac2b53b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789545590.380512:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454889088 00000100:00100000:0.0:1789545590.380517:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454889088 00000100:00100000:0.0:1789545590.380540:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789545590.380546:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:5843:x1876474454889088:12345-0@lo:503: 00000100:00100000:0.0:1789545590.380816:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:5843:x1876474454889088:12345-0@lo:503: Request processed in 268us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545590.380824:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789545590.380862:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454889088:0@lo:503: 00000100:00100000:1.0:1789545590.385662:0:7961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d99880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:7961:1876474454889216:0@lo:502: 00000100:00100000:1.0:1789545590.385745:0:7961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545590.385800:0:7961:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd938c000 going to sleep for 11 seconds 00000100:00100000:0.0:1789545590.385848:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454889216 00000100:00100000:0.0:1789545590.385855:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454889216 00000100:00100000:0.0:1789545590.385905:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789545590.385914:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:7961:x1876474454889216:12345-0@lo:502: 00000100:00100000:0.0:1789545590.386221:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:7961:x1876474454889216:12345-0@lo:502: Request processed in 308us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545590.386230:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789545590.386323:0:7961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d99880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:7961:1876474454889216:0@lo:502: 00000020:01000000:1.0:1789545590.386354:0:7961:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789545590.386403:0:7961:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789545590.386411:0:7961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789545590.386413:0:7961:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789545590.386418:0:7961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789545590.386422:0:7961:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.116@tcp to nid 0x20000c0a8c974 (192.168.201.116@tcp) 00000020:01000000:1.0:1789545590.386445:0:7961:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789545590.386449:0:7961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789545590.386466:0:7961:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff994bc65db380) 00000020:00000080:1.0:1789545590.386487:0:7961:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789545590.386494:0:7961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789545590.386565:0:7961:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789545590.386571:0:7961:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789545590.386578:0:7961:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x64919c0f856c0582 00010000:00080000:1.0:1789545590.386606:0:7961:0:(ldlm_lib.c:102:import_set_conn()) imp ffff994bdf6c8000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.116@tcp at head 00010000:00010000:1.0:1789545590.386846:0:7961:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1789545590.387160:0:7961:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1789545590.387171:0:7961:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789545590.387694:0:7961:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789545590.387949:0:7961:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789545590.388002:0:7961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1789545590.388057:0:7961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1789545590.396854:0:7962:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789545590.396866:0:7962:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789545590.403851:0:7961:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789545590.403865:0:7961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789545590.403908:0:7961:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789545590.403930:0:7961:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x64919c0f856c0589 00000100:00080000:1.0:1789545590.403939:0:7961:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789545590.403950:0:7961:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff994bdf6c8000 using connection 192.168.201.116@tcp/0@lo 00000100:00100000:1.0:1789545590.403984:0:7961:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994bd8d99880 x1876474454889344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789545590.404037:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876474454889344:0@lo:8: 00000100:00100000:2.0:1789545590.404102:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545590.404189:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454889344 00000100:00100000:3.0:1789545590.404197:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454889344 00000100:00100000:3.0:1789545590.404229:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789545590.404235:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1876474454889344:12345-0@lo:8: 00010000:00080000:3.0:1789545590.404257:0:6691:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:3.0:1789545590.404280:0:6691:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x64919c0f856c0590 00002000:00100000:3.0:1789545590.404291:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff994be4c98000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789545590.404295:0:6691:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1789545590.404299:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1789545590.404440:0:6691:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789545590.404563:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789545590.404585:0:6691:0:(import.c:65:import_set_state_nolock()) ffff994be4c9a800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1789545590.405503:0:7961:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789545590.405571:0:7961:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789545590.405576:0:7961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789545590.405579:0:7961:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789545590.405582:0:7961:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789545590.405585:0:7961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789545590.405587:0:7961:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789545590.405589:0:7961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789545590.405591:0:7961:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789545590.405620:0:7961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d9bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:7961:1876474454889472:0@lo:502: 00000100:00100000:1.0:1789545590.405676:0:7961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545590.405703:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454889472 00000100:00100000:1.0:1789545590.405708:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454889472 00000100:00100000:1.0:1789545590.405738:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789545590.405744:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:7961:x1876474454889472:12345-0@lo:502: 00000100:00100000:1.0:1789545590.405951:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:7961:x1876474454889472:12345-0@lo:502: Request processed in 206us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545590.405959:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789545590.406005:0:7961:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdf465840 going to sleep for 11 seconds 00000100:00100000:1.0:1789545590.406024:0:7961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d9bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:7961:1876474454889472:0@lo:502: 00000020:01000000:1.0:1789545590.406045:0:7961:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789545590.406049:0:7961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789545590.406050:0:7961:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789545590.406058:0:7961:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1789545590.406108:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1789545590.406126:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789545590.406135:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bee11a000/0x64919c0f856c056d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0574 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545590.406146:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bee11a000/0x64919c0f856c056d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0574 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789545590.406155:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789545590.406158:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff994bc65dcd40 from 1 10000000:01000000:1.0:1789545590.406160:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789545590.406183:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bee11ac00/0x64919c0f856c0597 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545590.406191:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bee11ac00/0x64919c0f856c0597 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545590.406200:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bee11ac00/0x64919c0f856c0597 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545590.406210:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454889600:0@lo:101: 00000100:00100000:1.0:1789545590.406234:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545590.406246:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdf465840 going to sleep for 11 seconds 00000100:00100000:1.0:1789545590.406257:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454889600 00000100:00100000:1.0:1789545590.406260:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454889600 00000100:00100000:1.0:1789545590.406277:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789545590.406283:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:5843:x1876474454889600:12345-0@lo:101: 00010000:00010000:1.0:1789545590.406291:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545590.406301:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bee11b200/0x64919c0f856c059e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c0597 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545590.406328:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bee11b200/0x64919c0f856c059e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c0597 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545590.406339:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bee11b200/0x64919c0f856c059e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0597 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545590.406347:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bee11b200, rc 0) 00000100:00100000:1.0:1789545590.406413:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:5843:x1876474454889600:12345-0@lo:101: Request processed in 129us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545590.406419:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789545590.406442:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454889600:0@lo:101: 00010000:00010000:1.0:1789545590.406453:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bee11ac00/0x64919c0f856c0597 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c059e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545590.406462:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bee11ac00/0x64919c0f856c0597 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c059e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545590.406495:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454889728:0@lo:501: 00000100:00100000:1.0:1789545590.406514:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545590.406525:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdf465840 going to sleep for 11 seconds 00000100:00100000:1.0:1789545590.406535:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454889728 00000100:00100000:1.0:1789545590.406538:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454889728 00000100:00100000:1.0:1789545590.406553:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789545590.406559:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:5843:x1876474454889728:12345-0@lo:501: 00000100:00100000:1.0:1789545590.406731:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:5843:x1876474454889728:12345-0@lo:501: Request processed in 170us (214us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789545590.406737:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789545590.406769:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454889728:0@lo:501: 10000000:01000000:1.0:1789545590.406798:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789545590.406803:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bee11ac00/0x64919c0f856c0597 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c059e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545590.406810:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bee11ac00/0x64919c0f856c0597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c059e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545590.413961:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1876474454889344:12345-0@lo:8: Request processed in 9716us (9849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545590.413976:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789545590.415607:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454889856:0@lo:400: 00000100:00100000:3.0:1789545590.415683:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545590.415724:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789545590.415730:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454889984:0@lo:400: 00000100:00100000:3.0:1789545590.415753:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545590.415793:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454890112:0@lo:400: 00000100:00100000:3.0:1789545590.415821:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545590.415841:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789545590.415846:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454890240:0@lo:400: 00000100:00100000:3.0:1789545590.415868:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545590.415901:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454889856 00000100:00100000:3.0:1789545590.415911:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454889856 00000100:00100000:3.0:1789545590.415955:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454889984 00000100:00100000:3.0:1789545590.415958:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454889984 00000100:00100000:3.0:1789545590.415971:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454890240 00000100:00100000:3.0:1789545590.415973:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454890240 00000100:00100000:3.0:1789545590.415987:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789545590.415996:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc641c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454889856:12345-0@lo:400: 00000100:00100000:3.0:1789545590.416059:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc641c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454889856:12345-0@lo:400: Request processed in 64us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545590.416066:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789545590.416084:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789545590.416089:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc641fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454889984:12345-0@lo:400: 00000100:00100000:3.0:1789545590.416114:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc641fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454889984:12345-0@lo:400: Request processed in 26us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545590.416119:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789545590.416129:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789545590.416134:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc641dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454890240:12345-0@lo:400: 00000100:00100000:3.0:1789545590.416172:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc641dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454890240:12345-0@lo:400: Request processed in 37us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545590.416177:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789545590.416198:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454890112 00000100:00100000:3.0:1789545590.416201:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454890112 00000100:00100000:3.0:1789545590.416224:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789545590.416230:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc641d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454890112:12345-0@lo:400: 00000100:00100000:3.0:1789545590.416259:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc641d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454890112:12345-0@lo:400: Request processed in 29us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545590.416264:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789545590.416301:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bc641f800 x1876474454890240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545590.416314:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454890240:0@lo:400: 00010000:00080000:3.0:1789545590.416323:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bc641e300 x1876474454890112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545590.416331:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454890112:0@lo:400: 00010000:00080000:3.0:1789545590.416399:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bc641f480 x1876474454889984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545590.416407:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454889984:0@lo:400: 00010000:00080000:3.0:1789545590.416418:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bc641f100 x1876474454889856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545590.416426:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454889856:0@lo:400: 00010000:00080000:2.0:1789545590.417706:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bd8d99880 x1876474454889344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789545600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545590.417720:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789545590.417731:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789545590.417740:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789545590.417746:0:3310:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789545590.417749:0:3310:0:(import.c:65:import_set_state_nolock()) ffff994bdf6c8000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789545590.417768:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789545590.417774:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876474454889344:0@lo:8: 00000004:00080000:0.0:1789545590.418002:0:7962:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789545590.418109:0:7962:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 204340748879ns, next at 0ns, rc = 0 00000004:00080000:0.0:1789545590.528663:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1789545590.529972:0:7964:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789545590.530008:0:7964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7964:1876474454890496:0@lo:7: 00000100:00100000:0.0:1789545590.530046:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454890368:0@lo:13: 00000100:00100000:2.0:1789545590.530091:0:7964:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545590.540436:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454890496 00000100:00100000:3.0:1789545590.540449:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454890496 00000100:00100000:3.0:1789545590.540528:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789545590.540537:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7964:x1876474454890496:12345-0@lo:7: 00002000:00080000:3.0:1789545590.545867:0:6692:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1789545590.545879:0:6692:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00080000:2.0:1789545590.546503:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789545590.546621:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545590.546676:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7964:x1876474454890496:12345-0@lo:7: Request processed in 6134us (16579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545590.546690:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789545590.547126:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454890368 00000100:00100000:1.0:1789545590.547136:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454890368 00000100:00100000:1.0:1789545590.547178:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789545590.547187:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876474454890368:12345-0@lo:13: 00002000:00000024:1.0:1789545590.547220:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1789545590.547276:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876474454890368:12345-0@lo:13: Request processed in 90us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545590.547284:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789545590.547327:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be54d1f80 x1876474454890368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545606 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545590.547505:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454890368:0@lo:13: 00000100:00100000:3.0:1789545590.548470:0:7964:0:(client.c:2716:ptlrpc_set_wait()) set ffff994be4e76000 going to sleep for 11 seconds 00010000:00080000:3.0:1789545590.548501:0:7964:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be54d0380 x1876474454890496/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789545606 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545590.548514:0:7964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7964:1876474454890496:0@lo:7: 00000004:00080000:3.0:1789545590.548527:0:7964:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789545590.548646:0:7964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7964:1876474454890624:0@lo:5: 00000100:00100000:3.0:1789545590.548697:0:7964:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545590.548745:0:7964:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc640ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1789545590.548757:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454890624 00000100:00100000:0.0:1789545590.548772:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454890624 00000100:00100000:0.0:1789545590.548865:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789545590.548881:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc641f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7964:x1876474454890624:12345-0@lo:5: 00002000:00080000:0.0:1789545590.548922:0:6691:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789545590.548929:0:6691:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789545590.550712:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc641f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7964:x1876474454890624:12345-0@lo:5: Request processed in 1828us (2006us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789545590.550729:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789545590.551784:0:7964:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bc641f100 x1876474454890624/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789545606 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545590.551805:0:7964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7964:1876474454890624:0@lo:5: 00000004:00080000:3.0:1789545590.551822:0:7964:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789545590.551868:0:7964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7964:1876474454890752:0@lo:700: 00000100:00100000:3.0:1789545590.551913:0:7964:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545590.551942:0:7964:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc640ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1789545590.551987:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454890752 00000100:00100000:0.0:1789545590.552002:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454890752 00000100:00100000:0.0:1789545590.552069:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789545590.552080:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc641f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7964:x1876474454890752:12345-0@lo:700: 00000100:00100000:0.0:1789545590.552143:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6699:1876474454890880:0@lo:700: 00000100:00100000:0.0:1789545590.552201:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545590.552244:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff994ac2b530c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789545590.552263:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454890880 00000100:00100000:3.0:1789545590.552271:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454890880 00000100:00100000:3.0:1789545590.552322:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789545590.552328:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6699:x1876474454890880:12345-0@lo:700: 00010000:00010000:1.0:1789545590.594149:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:3.0:1789545590.632063:0:5853:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1789545590.642000:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6699:x1876474454890880:12345-0@lo:700: Request processed in 89664us (89792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545590.642020:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789545590.642146:0:6699:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be54c5180 x1876474454890880/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789545606 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545590.642170:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6699:1876474454890880:0@lo:700: 40000000:02000000:0.0:1789545590.642191:0:6699:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:02000400:1.0:1789545590.709463:0:7996:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg116-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789545590.768733:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc641f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7964:x1876474454890752:12345-0@lo:700: Request processed in 216643us (216807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545590.768759:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:0.0:1789545590.768817:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1789545590.768831:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:2.0:1789545590.769209:0:7964:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bc641e300 x1876474454890752/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789545606 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545590.769229:0:7964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7964:1876474454890752:0@lo:700: 00000004:02000040:2.0:1789545590.840641:0:7964:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1789545590.844321:0:7964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7964:1876474454891008:0@lo:5: 00000100:00100000:1.0:1789545590.844544:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454891136:0@lo:13: 00000100:00100000:1.0:1789545590.844601:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545590.844684:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454891136 00000100:00100000:1.0:1789545590.844692:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454891136 00000100:00100000:1.0:1789545590.844742:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789545590.844751:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454891136:12345-0@lo:13: 00002000:00000024:1.0:1789545590.844812:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789545590.844856:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454891136:12345-0@lo:13: Request processed in 106us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545590.844863:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789545590.844921:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bd8d9bb80 x1876474454891136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545606 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545590.844938:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454891136:0@lo:13: 00000100:00100000:2.0:1789545590.845204:0:7964:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545590.845235:0:7964:0:(client.c:2716:ptlrpc_set_wait()) set ffff994ac2b539c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789545590.845316:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454891008 00000100:00100000:1.0:1789545590.845321:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454891008 00000100:00100000:2.0:1789545590.845433:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789545590.845442:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7964:x1876474454891008:12345-0@lo:5: 00002000:00080000:2.0:1789545590.855515:0:6693:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789545590.855533:0:6693:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1789545590.857192:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7964:x1876474454891008:12345-0@lo:5: Request processed in 11746us (11983us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789545590.857202:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789545590.857941:0:7964:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be54d3b80 x1876474454891008/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789545606 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545590.857952:0:7964:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789545590.857963:0:7964:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff994be54d3b80 x1876474454891008/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789545606 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545590.857971:0:7964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7964:1876474454891008:0@lo:5: 00000004:00080000:3.0:1789545590.857983:0:7964:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1789545591.612981:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545592.636524:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545593.660719:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545594.684705:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789545594.943861:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1789545595.461408:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454891520:0@lo:400: 00000100:00100000:3.0:1789545595.461420:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454891264:0@lo:400: 00000100:00100000:2.0:1789545595.461494:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876474454891392:0@lo:400: 00000100:00100000:3.0:1789545595.462178:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545595.462245:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454891776:0@lo:400: 00000100:00100000:3.0:1789545595.462274:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545595.462348:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454891776 00000100:00100000:3.0:1789545595.462355:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454891776 00000100:00100000:3.0:1789545595.462432:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789545595.462444:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc641f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454891776:12345-0@lo:400: 00000100:00100000:1.0:1789545595.462714:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454891264 00000100:00100000:1.0:1789545595.462719:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454891264 00000100:00100000:1.0:1789545595.462751:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789545595.462759:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454891264:12345-0@lo:400: 00000100:00100000:3.0:1789545595.462801:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc641f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454891776:12345-0@lo:400: Request processed in 359us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545595.462808:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1789545595.462832:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789545595.462879:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be54c5c00 x1876474454891776/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545595.462894:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454891776:0@lo:400: 00000100:00100000:1.0:1789545595.466146:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454891264:12345-0@lo:400: Request processed in 3380us (3961us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545595.466161:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789545595.466220:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454891264:0@lo:400: 00000100:00100000:2.0:1789545595.468981:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545595.469031:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454891392 00000100:00100000:3.0:1789545595.469040:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454891392 00000100:00100000:2.0:1789545595.469043:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454891904:0@lo:400: 00000100:00100000:2.0:1789545595.469075:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545595.469094:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789545595.469103:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876474454891392:12345-0@lo:400: 00000100:00100000:3.0:1789545595.469170:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876474454891392:12345-0@lo:400: Request processed in 67us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545595.469177:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789545595.469231:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454891648:0@lo:400: 00000100:00100000:0.0:1789545595.469259:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545595.469302:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454891904 00000100:00100000:0.0:1789545595.469306:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454891904 00000100:00100000:0.0:1789545595.469345:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454891648 00000100:00100000:0.0:1789545595.469349:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454891648 00000100:00100000:0.0:1789545595.469387:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789545595.469394:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454891904:12345-0@lo:400: 00000100:00100000:1.0:1789545595.469403:0:6692:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789545595.469411:0:6692:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789545595.469426:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454891904:12345-0@lo:400: Request processed in 33us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545595.469432:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789545595.469447:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789545595.469451:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454891648:12345-0@lo:400: 00000100:00100000:0.0:1789545595.469494:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454891648:12345-0@lo:400: Request processed in 42us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545595.469499:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789545595.469534:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be54c4380 x1876474454891648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545595.469547:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454891648:0@lo:400: 00000100:00100000:0.0:1789545595.469605:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:3.0:1789545595.469622:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789545595.469626:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789545595.469641:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545595.469713:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454891520 00000100:00100000:3.0:1789545595.469718:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454891520 00010000:00080000:2.0:1789545595.469735:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be54c7b80 x1876474454891392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545595.469746:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876474454891392:0@lo:400: 00000100:00100000:3.0:1789545595.469754:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1789545595.469757:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be54c7800 x1876474454891904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545595.469760:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454891520:12345-0@lo:400: 00000100:00100000:2.0:1789545595.469776:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789545595.469787:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454891904:0@lo:400: 00000100:00100000:3.0:1789545595.469795:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454891520:12345-0@lo:400: Request processed in 36us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545595.469801:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1789545595.469837:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be54c4700 x1876474454891520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545595.469845:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454891520:0@lo:400: 00000100:00100000:1.0:1789545595.469956:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438090880 00000100:00100000:1.0:1789545595.469960:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438090880 00000100:00100000:1.0:1789545595.469982:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 112 00000100:00100000:1.0:1789545595.469987:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2357:x1876474438090880:12345-192.168.201.16@tcp:250: 00010000:00080000:1.0:1789545595.470007:0:5838:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from c7941446-3286-4db8-8c2a-05ec7eed2433@192.168.201.16@tcp t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:1.0:1789545595.470031:0:5838:0:(genops.c:1384:class_connect()) connect: client c7941446-3286-4db8-8c2a-05ec7eed2433, cookie 0x64919c0f856c05a5 00000100:00080000:0.0:1789545595.470137:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789545595.470169:0:5838:0:(import.c:65:import_set_state_nolock()) ffff994ac21c3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789545595.470220:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+5:2357:x1876474438090880:12345-192.168.201.16@tcp:250: Request processed in 232us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545595.470227:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 112 00000100:00100000:0.0:1789545595.477204:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545595.477507:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438091008 00000100:00100000:1.0:1789545595.477517:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438091008 00000100:00100000:1.0:1789545595.477586:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 113 00000100:00100000:1.0:1789545595.477597:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+5:5582:x1876474438091008:12345-192.168.201.16@tcp:101: 00010000:00010000:1.0:1789545595.477613:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545595.477628:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bee11b800/0x64919c0f856c05ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de52e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545595.477655:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bee11b800/0x64919c0f856c05ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de52e4 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545595.477667:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bee11b800/0x64919c0f856c05ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de52e4 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545595.477676:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bee11b800, rc 0) 00000100:00100000:1.0:1789545595.477744:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+6:5582:x1876474438091008:12345-192.168.201.16@tcp:101: Request processed in 148us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545595.477752:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 113 00000100:00100000:3.0:1789545595.485832:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545595.486078:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438091136 00000100:00100000:0.0:1789545595.486089:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438091136 00000100:00100000:0.0:1789545595.486148:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 114 00000100:00100000:0.0:1789545595.486159:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+6:5582:x1876474438091136:12345-192.168.201.16@tcp:501: 00000100:00100000:0.0:1789545595.486530:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+6:5582:x1876474438091136:12345-192.168.201.16@tcp:501: Request processed in 371us (706us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789545595.486539:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 114 00000100:00100000:0.0:1789545595.488953:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545595.489031:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438091264 00000100:00100000:2.0:1789545595.489040:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438091264 00000100:00100000:2.0:1789545595.489279:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 115 00000100:00100000:2.0:1789545595.489290:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+6:5582:x1876474438091264:12345-192.168.201.16@tcp:101: 00010000:00010000:2.0:1789545595.489307:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545595.489325:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc49d0600/0x64919c0f856c05b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de52eb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545595.489352:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc49d0600/0x64919c0f856c05b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de52eb expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545595.489382:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc49d0600/0x64919c0f856c05b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de52eb expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545595.489392:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0600, rc 0) 00000100:00100000:2.0:1789545595.489453:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+7:5582:x1876474438091264:12345-192.168.201.16@tcp:101: Request processed in 164us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545595.489460:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 115 00000100:00100000:3.0:1789545595.491053:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545595.491227:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438091392 00000100:00100000:2.0:1789545595.491237:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438091392 00000100:00100000:2.0:1789545595.491291:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 116 00000100:00100000:2.0:1789545595.491300:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+7:5582:x1876474438091392:12345-192.168.201.16@tcp:501: 00000100:00100000:2.0:1789545595.491620:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+8:5582:x1876474438091392:12345-192.168.201.16@tcp:501: Request processed in 320us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545595.491639:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 116 00000100:00100000:1.0:1789545595.494064:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545595.494141:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438091520 00000100:00100000:2.0:1789545595.494151:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438091520 00000100:00100000:2.0:1789545595.494200:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 117 00000100:00100000:2.0:1789545595.494209:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+8:5582:x1876474438091520:12345-192.168.201.16@tcp:503: 00000100:00100000:2.0:1789545595.494582:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+8:5582:x1876474438091520:12345-192.168.201.16@tcp:503: Request processed in 372us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545595.494591:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 117 00000100:00100000:1.0:1789545595.500405:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545595.501519:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438091648 00000100:00100000:2.0:1789545595.501531:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438091648 00000100:00100000:2.0:1789545595.501594:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 118 00000100:00100000:2.0:1789545595.501604:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+8:5601:x1876474438091648:12345-192.168.201.16@tcp:502: 00000100:00100000:2.0:1789545595.501978:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+8:5601:x1876474438091648:12345-192.168.201.16@tcp:502: Request processed in 373us (1581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545595.501987:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 118 00000100:00100000:3.0:1789545595.530739:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545595.530828:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438091776 00000100:00100000:2.0:1789545595.530838:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438091776 00000100:00100000:2.0:1789545595.530896:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 119 00000100:00100000:2.0:1789545595.530906:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+8:5601:x1876474438091776:12345-192.168.201.16@tcp:502: 00000100:00100000:2.0:1789545595.531168:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+8:5601:x1876474438091776:12345-192.168.201.16@tcp:502: Request processed in 262us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545595.531176:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 119 00000100:00100000:3.0:1789545595.539576:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545595.539654:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438091904 00000100:00100000:1.0:1789545595.539669:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438091904 00000100:00100000:1.0:1789545595.539741:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 120 00000100:00100000:1.0:1789545595.539752:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+8:5582:x1876474438091904:12345-192.168.201.16@tcp:101: 00010000:00010000:1.0:1789545595.539783:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545595.539801:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bee11b400/0x64919c0f856c05ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5315 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545595.539835:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bee11b400/0x64919c0f856c05ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5315 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545595.539848:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bee11b400/0x64919c0f856c05ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5315 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545595.539858:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bee11b400, rc 0) 00000100:00100000:1.0:1789545595.539933:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+9:5582:x1876474438091904:12345-192.168.201.16@tcp:101: Request processed in 183us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545595.539941:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 120 00000100:00100000:2.0:1789545595.545602:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545595.545751:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438092032 00000100:00100000:3.0:1789545595.545784:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438092032 00000100:00100000:3.0:1789545595.545852:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 121 00000100:00100000:3.0:1789545595.545863:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+9:5582:x1876474438092032:12345-192.168.201.16@tcp:256: 20000000:01000000:3.0:1789545595.545889:0:5840:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789545595.545906:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789545595.545912:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789545595.545916:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789545595.545918:0:5840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1789545595.550016:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+9:5582:x1876474438092032:12345-192.168.201.16@tcp:256: Request processed in 4142us (4415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545595.550102:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 121 00000100:00100000:1.0:1789545595.555607:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545595.555677:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438092160 00000100:00100000:2.0:1789545595.555702:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438092160 00000100:00100000:2.0:1789545595.555877:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 122 00000100:00100000:2.0:1789545595.555892:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+9:5582:x1876474438092160:12345-192.168.201.16@tcp:101: 00010000:00010000:2.0:1789545595.555914:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545595.555938:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc49d1600/0x64919c0f856c05c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de531c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545595.555977:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc49d1600/0x64919c0f856c05c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de531c expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545595.555990:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc49d1600/0x64919c0f856c05c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de531c expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545595.556002:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1600, rc 0) 00000100:00100000:2.0:1789545595.556139:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+10:5582:x1876474438092160:12345-192.168.201.16@tcp:101: Request processed in 251us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545595.556147:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 122 00000100:00100000:3.0:1789545595.567310:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545595.567507:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438092288 00000100:00100000:0.0:1789545595.567521:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438092288 00000100:00100000:0.0:1789545595.567588:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 123 00000100:00100000:0.0:1789545595.567601:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+10:5582:x1876474438092288:12345-192.168.201.16@tcp:501: 00000100:00100000:0.0:1789545595.568004:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+10:5582:x1876474438092288:12345-192.168.201.16@tcp:501: Request processed in 404us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545595.568013:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 123 00000100:00100000:0.0:1789545595.572112:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545595.572296:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438092416 00000100:00100000:2.0:1789545595.572310:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438092416 00000100:00100000:0.0:1789545595.572400:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 124 00000100:00100000:0.0:1789545595.572415:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+10:5582:x1876474438092416:12345-192.168.201.16@tcp:503: 00000100:00100000:1.0:1789545595.572970:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+10:5582:x1876474438092416:12345-192.168.201.16@tcp:503: Request processed in 556us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545595.572980:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 124 00000100:00100000:1.0:1789545595.581903:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545595.582005:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438092544 00000100:00100000:3.0:1789545595.582019:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438092544 00000100:00100000:3.0:1789545595.582093:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 125 00000100:00100000:3.0:1789545595.582105:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+10:5605:x1876474438092544:12345-192.168.201.16@tcp:502: 00000100:00100000:3.0:1789545595.582826:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+10:5605:x1876474438092544:12345-192.168.201.16@tcp:502: Request processed in 719us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545595.582836:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 125 00000100:00100000:3.0:1789545595.594848:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545595.595075:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438092672 00000100:00100000:1.0:1789545595.595089:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438092672 00000100:00100000:1.0:1789545595.595164:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 126 00000100:00100000:1.0:1789545595.595177:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+10:5605:x1876474438092672:12345-192.168.201.16@tcp:502: 00000100:00100000:1.0:1789545595.595874:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+10:5605:x1876474438092672:12345-192.168.201.16@tcp:502: Request processed in 695us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545595.595885:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 126 00000100:00100000:0.0:1789545595.603553:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545595.603683:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438092800 00000100:00100000:1.0:1789545595.603720:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438092800 00000100:00100000:1.0:1789545595.603781:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 4 00000100:00100000:1.0:1789545595.603791:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2357:x1876474438092800:12345-192.168.201.16@tcp:38: 00010000:00080000:1.0:1789545595.603828:0:5846:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 8a8edb7a-f384-4468-93f4-9d664f284862@192.168.201.16@tcp t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:1.0:1789545595.603889:0:5846:0:(genops.c:1384:class_connect()) connect: client 8a8edb7a-f384-4468-93f4-9d664f284862, cookie 0x64919c0f856c05c8 00000004:00100000:1.0:1789545595.603929:0:5846:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1789545595.603937:0:5846:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1789545595.649234:0:5846:0:(import.c:65:import_set_state_nolock()) ffff994be47a1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789545595.649444:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+6:2357:x1876474438092800:12345-192.168.201.16@tcp:38: Request processed in 45651us (45903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545595.649458:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 4 00010000:00010000:3.0:1789545595.708625:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545595.965222:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454892032:0@lo:13: 00000100:00100000:0.0:1789545595.965334:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545595.966033:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789545595.966048:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454892160:0@lo:13: 00000100:00100000:0.0:1789545595.966103:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545595.966199:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454892032 00000100:00100000:3.0:1789545595.966210:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454892032 00000100:00100000:3.0:1789545595.966273:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454892160 00000100:00100000:3.0:1789545595.966277:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454892160 00000100:00100000:3.0:1789545595.966298:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789545595.966310:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454892032:12345-0@lo:13: 00002000:00000024:3.0:1789545595.966377:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789545595.966454:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454892032:12345-0@lo:13: Request processed in 146us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545595.966462:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789545595.966484:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789545595.966491:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454892160:12345-0@lo:13: 00002000:00000024:3.0:1789545595.966522:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789545595.966549:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454892160:12345-0@lo:13: Request processed in 59us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545595.966556:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789545595.966752:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bc641e300 x1876474454892160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545611 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545595.966776:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454892160:0@lo:13: 00010000:00080000:0.0:1789545595.966788:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bc641e680 x1876474454892032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545611 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545595.966801:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454892032:0@lo:13: 00000100:00100000:3.0:1789545596.655785:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545596.655833:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545596.656129:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438092928 00000100:00100000:0.0:1789545596.656140:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438092928 00000100:00100000:0.0:1789545596.656210:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438093056 00000100:00100000:0.0:1789545596.656214:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438093056 00000100:00100000:0.0:1789545596.656235:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 5 00000100:00100000:0.0:1789545596.656245:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc641e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+7:0:x1876474438092928:12345-192.168.201.16@tcp:41: 00000004:00000024:0.0:1789545596.656291:0:5847:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789545596.656393:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc641e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+7:0:x1876474438092928:12345-192.168.201.16@tcp:41: Request processed in 116us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545596.656401:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 5 00000100:00100000:0.0:1789545596.656433:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 6 00000100:00100000:0.0:1789545596.656441:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc641e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+6:5582:x1876474438093056:12345-192.168.201.16@tcp:41: 00000004:00000024:0.0:1789545596.656452:0:5847:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789545596.656473:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc641e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+6:5582:x1876474438093056:12345-192.168.201.16@tcp:41: Request processed in 34us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545596.656480:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 6 00000100:00080000:3.0:1789545596.656681:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789545596.658752:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545596.659021:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438093184 00000100:00100000:0.0:1789545596.659031:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438093184 00000100:00100000:0.0:1789545596.659141:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7 00000100:00100000:0.0:1789545596.659151:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+6:5582:x1876474438093184:12345-192.168.201.16@tcp:40: 00000100:00100000:0.0:1789545596.659232:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+6:5582:x1876474438093184:12345-192.168.201.16@tcp:40: Request processed in 83us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545596.659239:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7 00000100:00100000:1.0:1789545596.664655:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545596.664705:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545596.664753:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545596.664757:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438093312 00000100:00100000:3.0:1789545596.664767:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438093312 00000100:00100000:1.0:1789545596.664786:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545596.664868:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438093696 00000100:00100000:2.0:1789545596.664873:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438093696 00000100:00100000:2.0:1789545596.664907:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 127 00000100:00100000:2.0:1789545596.664917:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bf56acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+10:2361:x1876474438093696:12345-192.168.201.16@tcp:400: 00000100:00100000:2.0:1789545596.664987:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bf56acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+10:2361:x1876474438093696:12345-192.168.201.16@tcp:400: Request processed in 71us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545596.665012:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 127 00000100:00100000:1.0:1789545596.665228:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438093568 00000100:00100000:1.0:1789545596.665234:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438093568 00000100:00100000:1.0:1789545596.665266:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 0 00000100:00100000:1.0:1789545596.665275:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+6:5582:x1876474438093568:12345-192.168.201.16@tcp:33: 00000100:00100000:3.0:1789545596.665449:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438093440 00000100:00100000:3.0:1789545596.665453:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438093440 00000100:00100000:3.0:1789545596.665475:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8 00000100:00100000:3.0:1789545596.665481:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1876474438093312:12345-192.168.201.16@tcp:8: 00010000:00080000:3.0:1789545596.665515:0:6691:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 8a8edb7a-f384-4468-93f4-9d664f284862@192.168.201.16@tcp t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:3.0:1789545596.665540:0:6691:0:(genops.c:1384:class_connect()) connect: client 8a8edb7a-f384-4468-93f4-9d664f284862, cookie 0x64919c0f856c05cf 00002000:00100000:3.0:1789545596.665551:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8a8edb7a-f384-4468-93f4-9d664f284862/ffff994be4c9e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789545596.665561:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789545596.665902:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789545596.665933:0:6691:0:(import.c:65:import_set_state_nolock()) ffff994be4c98800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789545596.665977:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+6:2357:x1876474438093312:12345-192.168.201.16@tcp:8: Request processed in 494us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545596.665992:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8 00000100:00100000:3.0:1789545596.666008:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9 00000100:00100000:3.0:1789545596.666013:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1876474438093440:12345-192.168.201.16@tcp:8: 00010000:00080000:3.0:1789545596.666026:0:6691:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 8a8edb7a-f384-4468-93f4-9d664f284862@192.168.201.16@tcp t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:3.0:1789545596.666041:0:6691:0:(genops.c:1384:class_connect()) connect: client 8a8edb7a-f384-4468-93f4-9d664f284862, cookie 0x64919c0f856c05d6 00002000:00100000:3.0:1789545596.666046:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8a8edb7a-f384-4468-93f4-9d664f284862/ffff994be4c9a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789545596.666051:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789545596.666230:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789545596.666245:0:6691:0:(import.c:65:import_set_state_nolock()) ffff994be4c9d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789545596.673157:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+6:2357:x1876474438093440:12345-192.168.201.16@tcp:8: Request processed in 7130us (8359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545596.673172:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9 00000004:00080000:1.0:1789545596.706069:0:5849:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 40732us 00000004:00200000:1.0:1789545596.721037:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789545596.721157:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+6:5582:x1876474438093568:12345-192.168.201.16@tcp:33: Request processed in 55878us (56446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545596.721168:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 0 00010000:00010000:1.0:1789545596.733183:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545596.911598:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545596.911756:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438093824 00000100:00100000:3.0:1789545596.911770:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438093824 00000100:00100000:3.0:1789545596.911918:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8 00000100:00100000:3.0:1789545596.911931:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+6:5622:x1876474438093824:12345-192.168.201.16@tcp:101: 00010000:00010000:3.0:1789545596.911959:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545596.911994:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e800/0x64919c0f856c05dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5346 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545596.912087:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c05e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545596.912105:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c05e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545596.912148:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c05e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545596.912195:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789545596.912199:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789545596.912221:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c05e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545596.912252:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e800/0x64919c0f856c05dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5346 expref: 8 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545596.912290:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c05e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5346 expref: 7 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545596.912300:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4f9e800) 00010000:00010000:3.0:1789545596.912304:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789545596.912308:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217fe00, rc 0) 00000100:00100000:3.0:1789545596.912440:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+7:5622:x1876474438093824:12345-192.168.201.16@tcp:101: Request processed in 512us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545596.912448:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8 00010000:00010000:3.0:1789545597.756739:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545598.780514:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545598.918766:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545598.918856:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438093952 00000100:00100000:3.0:1789545598.918867:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438093952 00000100:00100000:3.0:1789545598.918956:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9 00000100:00100000:3.0:1789545598.918970:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+7:5675:x1876474438093952:12345-192.168.201.16@tcp:41: 00000004:00000024:3.0:1789545598.919017:0:5847:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789545598.919086:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+7:5675:x1876474438093952:12345-192.168.201.16@tcp:41: Request processed in 120us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545598.919106:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9 00000100:00080000:0.0:1789545598.919307:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789545598.921656:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545598.921738:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438094080 00000100:00100000:3.0:1789545598.921747:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438094080 00000100:00100000:3.0:1789545598.921940:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8 00000100:00100000:3.0:1789545598.921963:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8a8edb7a-f384-4468-93f4-9d664f284862+6:5675:x1876474438094080:12345-192.168.201.16@tcp:13: 00002000:00000024:3.0:1789545598.922000:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789545598.922070:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8a8edb7a-f384-4468-93f4-9d664f284862+6:5675:x1876474438094080:12345-192.168.201.16@tcp:13: Request processed in 119us (421us total) trans 0 rc 0/0 00000100:00080000:0.0:1789545598.922106:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789545598.928283:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8 00000100:00100000:1.0:1789545598.929231:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545598.929354:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438094208 00000100:00100000:2.0:1789545598.929380:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438094208 00000100:00100000:2.0:1789545598.929525:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9 00000100:00100000:2.0:1789545598.929537:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8a8edb7a-f384-4468-93f4-9d664f284862+6:5675:x1876474438094208:12345-192.168.201.16@tcp:13: 00002000:00000024:2.0:1789545598.929576:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789545598.929654:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8a8edb7a-f384-4468-93f4-9d664f284862+6:5675:x1876474438094208:12345-192.168.201.16@tcp:13: Request processed in 119us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545598.929661:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9 00000100:00080000:0.0:1789545598.930172:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789545599.806601:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789545600.093634:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8a8edb7a-f384-4468-93f4-9d664f284862 00000100:00100000:2.0:1789545600.576484:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876474454892416:0@lo:400: 00000100:00100000:2.0:1789545600.576562:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545600.576636:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454892928:0@lo:400: 00000100:00100000:2.0:1789545600.576664:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545600.576975:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454892544:0@lo:400: 00000100:00100000:2.0:1789545600.577000:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545600.577031:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789545600.577037:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454892672:0@lo:400: 00000100:00100000:2.0:1789545600.577058:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545600.577093:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454892416 00000100:00100000:2.0:1789545600.577112:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454892416 00000100:00100000:2.0:1789545600.577152:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454892544 00000100:00100000:2.0:1789545600.577155:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454892544 00000100:00100000:2.0:1789545600.577177:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789545600.577184:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876474454892416:12345-0@lo:400: 00000100:00100000:2.0:1789545600.577235:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876474454892416:12345-0@lo:400: Request processed in 51us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545600.577242:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789545600.577258:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789545600.577263:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454892544:12345-0@lo:400: 00000100:00100000:2.0:1789545600.577287:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454892544:12345-0@lo:400: Request processed in 25us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545600.577292:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789545600.577312:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454892928 00000100:00100000:2.0:1789545600.577315:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454892928 00000100:00100000:2.0:1789545600.577337:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454892672 00000100:00100000:2.0:1789545600.577340:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454892672 00000100:00100000:2.0:1789545600.577355:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789545600.577388:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454892928:12345-0@lo:400: 00000100:00100000:2.0:1789545600.577419:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454892928:12345-0@lo:400: Request processed in 34us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545600.577424:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789545600.577436:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789545600.577442:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454892672:12345-0@lo:400: 00000100:00100000:2.0:1789545600.577467:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454892672:12345-0@lo:400: Request processed in 26us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545600.577472:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1789545600.577491:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789545600.577494:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789545600.577496:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789545600.577527:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be54d1180 x1876474454892672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545600.577552:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454892672:0@lo:400: 00000100:00100000:2.0:1789545600.577567:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454892544:0@lo:400: 00010000:00080000:2.0:1789545600.577619:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be54d0e00 x1876474454892928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545600.577628:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454892928:0@lo:400: 00000100:00100000:2.0:1789545600.577644:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876474454892416:0@lo:400: 00000100:00100000:2.0:1789545600.577651:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789545600.577656:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454892288:0@lo:400: 00000100:00100000:2.0:1789545600.577697:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545600.577732:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454892800:0@lo:400: 00000100:00100000:0.0:1789545600.577769:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454892288 00000100:00100000:0.0:1789545600.577774:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454892288 00000100:00100000:0.0:1789545600.577798:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789545600.577805:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3312:x1876474454892288:12345-0@lo:400: 00000100:00100000:0.0:1789545600.577839:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3312:x1876474454892288:12345-0@lo:400: Request processed in 34us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545600.577845:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789545600.579172:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545600.579278:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454892288:0@lo:400: 00000100:00100000:1.0:1789545600.579614:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454892800 00000100:00100000:1.0:1789545600.579621:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454892800 00000100:00100000:1.0:1789545600.579706:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789545600.579723:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454892800:12345-0@lo:400: 00000100:00100000:1.0:1789545600.579780:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454892800:12345-0@lo:400: Request processed in 59us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545600.579787:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789545600.579825:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454892800:0@lo:400: 00000100:00080000:3.0:1789545600.579869:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1789545600.623411:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8a8edb7a-f384-4468-93f4-9d664f284862 00010000:00010000:1.0:1789545600.830526:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545601.086372:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454893056:0@lo:13: 00000100:00100000:2.0:1789545601.086444:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545601.086527:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454893056 00000100:00100000:2.0:1789545601.086536:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454893056 00000100:00100000:2.0:1789545601.086584:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789545601.086592:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454893056:12345-0@lo:13: 00002000:00000024:2.0:1789545601.086639:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789545601.086688:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454893056:12345-0@lo:13: Request processed in 96us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545601.086695:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1789545601.086741:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be518c700 x1876474454893056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545617 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545601.086782:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454893056:0@lo:13: 00000100:00100000:1.0:1789545601.087983:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994becd93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454893184:0@lo:13: 00000100:00100000:1.0:1789545601.088025:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545601.088655:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454893184 00000100:00100000:1.0:1789545601.088664:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454893184 00000100:00100000:1.0:1789545601.088700:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789545601.088707:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454893184:12345-0@lo:13: 00002000:00000024:1.0:1789545601.088733:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789545601.088774:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454893184:12345-0@lo:13: Request processed in 67us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545601.088780:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1789545601.088812:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994becd93100 x1876474454893184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545617 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545601.088828:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994becd93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454893184:0@lo:13: 00000001:00100000:0.0:1789545601.119632:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8a8edb7a-f384-4468-93f4-9d664f284862 00000001:02000400:2.0:1789545601.137531:0:8301:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789545601.852840:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545601.985763:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545601.987756:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545601.987798:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545601.987870:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545601.988223:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438094464 00000100:00100000:3.0:1789545601.988234:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438094464 00000100:00100000:3.0:1789545601.988303:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 23 00000100:00100000:3.0:1789545601.988313:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+6:2358:x1876474438094464:12345-192.168.201.16@tcp:400: 00000100:00100000:3.0:1789545601.988398:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+6:2358:x1876474438094464:12345-192.168.201.16@tcp:400: Request processed in 86us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545601.988405:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 23 00000100:00080000:3.0:1789545601.988426:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789545601.991911:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438094720 00000100:00100000:0.0:1789545601.991928:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438094720 00000100:00100000:0.0:1789545601.992013:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438094592 00000100:00100000:0.0:1789545601.992018:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438094592 00000100:00100000:0.0:1789545601.992047:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8 00000100:00100000:0.0:1789545601.992059:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+5:2359:x1876474438094720:12345-192.168.201.16@tcp:400: 00000100:00100000:0.0:1789545601.992122:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+5:2359:x1876474438094720:12345-192.168.201.16@tcp:400: Request processed in 65us (4322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545601.992136:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8 00000100:00100000:0.0:1789545601.992153:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9 00000100:00100000:0.0:1789545601.992159:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+5:2358:x1876474438094592:12345-192.168.201.16@tcp:400: 00000100:00100000:0.0:1789545601.992179:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+5:2358:x1876474438094592:12345-192.168.201.16@tcp:400: Request processed in 20us (4308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545601.992184:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9 00000100:00080000:0.0:1789545601.992205:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789545601.992208:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789545601.992773:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438094336 00000100:00100000:2.0:1789545601.992779:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438094336 00000100:00100000:2.0:1789545601.992832:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 129 00000100:00100000:2.0:1789545601.992841:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+10:2358:x1876474438094336:12345-192.168.201.16@tcp:400: 00000100:00100000:2.0:1789545601.992881:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+10:2358:x1876474438094336:12345-192.168.201.16@tcp:400: Request processed in 41us (7128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545601.992888:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 129 00010000:00010000:1.0:1789545602.877846:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545603.900779:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789545604.542928:0:8448:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb9643740 20000000:00000080:0.0:1789545604.542946:0:8448:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff994be51a6000 uarg=0000000000000000 20000000:01000000:0.0:1789545604.542984:0:8448:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1789545604.542986:0:8448:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1789545604.542989:0:8448:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789545604.542994:0:8448:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789545604.543000:0:8448:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1789545604.543015:0:8448:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789545604.543018:0:8448:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789545604.544085:0:8448:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789545604.544090:0:8448:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789545604.546053:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1789545604.553956:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1789545604.554014:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1789545604.554069:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1789545604.554096:0:8448:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789545604.554099:0:8448:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789545604.555758:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1789545604.556194:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1789545604.556259:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1789545604.556308:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1789545604.556327:0:8448:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789545604.556330:0:8448:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789545604.557084:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1789545604.557672:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1789545604.557708:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1789545604.557735:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1789545604.557750:0:8448:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789545604.557752:0:8448:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789545604.558741:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1789545604.559089:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1789545604.559207:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1789545604.559244:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:3.0:1789545604.559259:0:8448:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789545604.559277:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff994c0217e800/0x64919c0f856c05eb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.559545:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bc0030000/0x64919c0f856c04e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c04e1 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.559557:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bc49d1400/0x64919c0f856c0512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c050b expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.559563:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bc49d0400/0x64919c0f856c053c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0535 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.559569:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bee11be00/0x64919c0f856c054a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0543 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.559575:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bee11ae00/0x64919c0f856c0558 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0551 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.559593:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994c0217f800/0x64919c0f856c0574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c056d expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.559600:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bee11b200/0x64919c0f856c059e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0597 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.559610:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bee11b800/0x64919c0f856c05ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de52e4 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.559618:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bc49d0600/0x64919c0f856c05b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de52eb expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.559626:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff994c0217e800/0x64919c0f856c05eb lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.559675:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bc49d0600/0x64919c0f856c05b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de52eb expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.559691:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994bc49d0600/0x64919c0f856c05b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de52eb expref: 9 pid: 5838 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545604.559707:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb43800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1876474454893312:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545604.559850:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bee11b800/0x64919c0f856c05ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de52e4 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.559858:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994bee11b800/0x64919c0f856c05ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de52e4 expref: 9 pid: 5839 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545604.559867:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb43480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1876474454893440:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545604.559942:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bee11b200/0x64919c0f856c059e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c0597 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.559951:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994bee11b200/0x64919c0f856c059e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c0597 expref: 18 pid: 5840 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545604.559960:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb42a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1876474454893568:0@lo:104: 00000100:00100000:3.0:1789545604.560002:0:8448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789545604.560057:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994c0217f800/0x64919c0f856c0574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c056d expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.560065:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994c0217f800/0x64919c0f856c0574 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c056d expref: 18 pid: 5839 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545604.560074:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb40e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1876474454893696:0@lo:104: 00000100:00100000:3.0:1789545604.560098:0:8448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789545604.560184:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bee11ae00/0x64919c0f856c0558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c0551 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.560192:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994bee11ae00/0x64919c0f856c0558 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c0551 expref: 18 pid: 5839 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545604.560199:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb41180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1876474454893824:0@lo:104: 00010000:00010000:3.0:1789545604.560220:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bee11be00/0x64919c0f856c054a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c0543 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.560228:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994bee11be00/0x64919c0f856c054a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c0543 expref: 18 pid: 5839 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545604.560235:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb43100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1876474454893952:0@lo:104: 00010000:00010000:3.0:1789545604.560268:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bc49d0400/0x64919c0f856c053c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c0535 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.560276:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994bc49d0400/0x64919c0f856c053c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c0535 expref: 18 pid: 5840 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545604.560283:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb41c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1876474454894080:0@lo:104: 00010000:00010000:3.0:1789545604.560322:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bc49d1400/0x64919c0f856c0512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c050b expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.560329:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994bc49d1400/0x64919c0f856c0512 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c050b expref: 18 pid: 5838 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545604.560336:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb40700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1876474454894208:0@lo:104: 00010000:00010000:3.0:1789545604.560403:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bc0030000/0x64919c0f856c04e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c04e1 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.560414:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994bc0030000/0x64919c0f856c04e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c04e1 expref: 18 pid: 5839 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545604.560422:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb40a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1876474454894336:0@lo:104: 00000100:00100000:3.0:1789545604.560439:0:8448:0:(client.c:2716:ptlrpc_set_wait()) set ffff994becff1300 going to sleep for 11 seconds 00000100:00100000:2.0:1789545604.560930:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789545604.560952:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545604.560986:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545604.560996:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545604.561004:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545604.561013:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545604.561036:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454893568 00000100:00100000:2.0:1789545604.561045:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454893568 00000100:00100000:2.0:1789545604.561084:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454893696 00000100:00100000:2.0:1789545604.561087:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454893696 00000100:00100000:2.0:1789545604.561098:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454893824 00000100:00100000:2.0:1789545604.561100:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454893824 00000100:00100000:2.0:1789545604.561110:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454893952 00000100:00100000:2.0:1789545604.561112:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454893952 00000100:00100000:2.0:1789545604.561509:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454894080 00000100:00100000:2.0:1789545604.561514:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454894080 00000100:00100000:2.0:1789545604.561526:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454894208 00000100:00100000:2.0:1789545604.561529:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454894208 00000100:00100000:2.0:1789545604.561547:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454894336 00000100:00100000:2.0:1789545604.561549:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454894336 00000100:00100000:2.0:1789545604.561578:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789545604.561587:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+9:8448:x1876474454893568:12345-0@lo:104: 00010000:00010000:2.0:1789545604.561601:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994bee11ac00/0x64919c0f856c0597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c059e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.561669:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789545604.561674:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+9:8448:x1876474454893568:12345-0@lo:104: Request processed in 89us (1671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545604.561681:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789545604.561697:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789545604.561703:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becda8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+8:8448:x1876474454893696:12345-0@lo:104: 00010000:00010000:2.0:1789545604.561710:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994bee11a000/0x64919c0f856c056d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c0574 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.561740:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789545604.561745:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becda8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+8:8448:x1876474454893696:12345-0@lo:104: Request processed in 43us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545604.561749:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789545604.561781:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789545604.561787:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+7:8448:x1876474454893824:12345-0@lo:104: 00010000:00010000:2.0:1789545604.561794:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994bee11aa00/0x64919c0f856c0551 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c0558 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.561820:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789545604.561824:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+7:8448:x1876474454893824:12345-0@lo:104: Request processed in 38us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545604.561829:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789545604.561839:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789545604.561850:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+6:8448:x1876474454893952:12345-0@lo:104: 00010000:00010000:2.0:1789545604.561858:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994bc49d0e00/0x64919c0f856c0543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c054a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.561884:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789545604.561889:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+6:8448:x1876474454893952:12345-0@lo:104: Request processed in 39us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545604.561895:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789545604.561906:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789545604.561912:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+5:8448:x1876474454894080:12345-0@lo:104: 00010000:00010000:2.0:1789545604.561919:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994bc0031800/0x64919c0f856c0535 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c053c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.561944:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789545604.561949:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+5:8448:x1876474454894080:12345-0@lo:104: Request processed in 38us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545604.561955:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789545604.561965:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789545604.561970:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+4:8448:x1876474454894208:12345-0@lo:104: 00010000:00010000:2.0:1789545604.561978:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994bee11b000/0x64919c0f856c050b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c0512 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.562003:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1789545604.562007:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+4:8448:x1876474454894208:12345-0@lo:104: Request processed in 38us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545604.562014:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789545604.562025:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789545604.564966:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+3:8448:x1876474454894336:12345-0@lo:104: 00010000:00010000:2.0:1789545604.564986:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c04e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c04e8 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.565201:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1789545604.565208:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+3:8448:x1876474454894336:12345-0@lo:104: Request processed in 259us (4193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545604.565215:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1789545604.565258:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789545604.565265:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bee11ac00/0x64919c0f856c0597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c059e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.565274:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bee11ac00 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:2.0:1789545604.565279:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bee11ac00/0x64919c0f856c0597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c059e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.565290:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bee11ac00/0x64919c0f856c0597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c059e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789545604.565631:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bee11ac00/0x64919c0f856c0597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c059e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789545604.565637:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789545604.565688:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bee11ac00/0x64919c0f856c0597 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c059e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.565695:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789545604.565723:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bee11ac00/0x64919c0f856c0597 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c059e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.565747:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bee11ac00/0x64919c0f856c0597 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c059e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.565762:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789545604.565766:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bee11a000/0x64919c0f856c056d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c0574 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.565772:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bee11a000 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:2.0:1789545604.565776:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bee11a000/0x64919c0f856c056d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c0574 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.565783:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bee11a000/0x64919c0f856c056d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c0574 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789545604.565790:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bee11a000/0x64919c0f856c056d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c0574 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789545604.565795:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789545604.565809:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bee11a000/0x64919c0f856c056d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0574 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.565816:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789545604.565821:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bee11a000/0x64919c0f856c056d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0574 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.565828:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bee11a000/0x64919c0f856c056d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0574 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.565836:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789545604.565846:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bee11aa00/0x64919c0f856c0551 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c0558 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.565852:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bee11aa00 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:2.0:1789545604.565855:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bee11aa00/0x64919c0f856c0551 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c0558 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.565862:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bee11aa00/0x64919c0f856c0551 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c0558 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789545604.565868:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bee11aa00/0x64919c0f856c0551 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c0558 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789545604.565873:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789545604.565886:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bee11aa00/0x64919c0f856c0551 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0558 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.565891:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789545604.565906:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bee11aa00/0x64919c0f856c0551 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0558 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.565912:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bee11aa00/0x64919c0f856c0551 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0558 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.565921:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789545604.565924:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bc49d0e00/0x64919c0f856c0543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c054a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.565930:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0e00 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:2.0:1789545604.565933:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bc49d0e00/0x64919c0f856c0543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c054a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.565949:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bc49d0e00/0x64919c0f856c0543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c054a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789545604.565955:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bc49d0e00/0x64919c0f856c0543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c054a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789545604.565960:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789545604.565972:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bc49d0e00/0x64919c0f856c0543 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c054a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.565977:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789545604.565982:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bc49d0e00/0x64919c0f856c0543 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c054a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.565988:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bc49d0e00/0x64919c0f856c0543 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c054a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.565997:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789545604.566000:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bc0031800/0x64919c0f856c0535 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c053c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.566006:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc0031800 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:2.0:1789545604.566008:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bc0031800/0x64919c0f856c0535 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c053c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.566014:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bc0031800/0x64919c0f856c0535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c053c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789545604.566021:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bc0031800/0x64919c0f856c0535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c053c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545604.566348:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb42a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1876474454893568:0@lo:104: 00000100:00100000:3.0:1789545604.566625:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb40e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1876474454893696:0@lo:104: 00000100:00100000:3.0:1789545604.566637:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb41180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1876474454893824:0@lo:104: 00000100:00100000:3.0:1789545604.566645:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb43100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1876474454893952:0@lo:104: 00000100:00100000:3.0:1789545604.566653:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb41c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1876474454894080:0@lo:104: 00000100:00100000:3.0:1789545604.566661:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb40700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1876474454894208:0@lo:104: 00000100:00100000:3.0:1789545604.566680:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb40a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1876474454894336:0@lo:104: 00000100:00100000:3.0:1789545604.566719:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454894464:0@lo:103: 00000100:00100000:3.0:1789545604.566767:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545604.566809:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789545604.566815:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454894592:0@lo:103: 00000100:00100000:3.0:1789545604.566834:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545604.566875:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454894464 00000100:00100000:3.0:1789545604.566882:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454894464 00010000:00010000:3.0:1789545604.566913:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bee11b200/0x64919c0f856c059e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c0597 expref: 19 pid: 5840 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545604.566936:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454894592 00000100:00100000:3.0:1789545604.566940:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454894592 00010000:00010000:3.0:1789545604.566951:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994c0217f800/0x64919c0f856c0574 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c056d expref: 20 pid: 5839 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545604.566969:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789545604.566977:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+20:3311:x1876474454894464:12345-0@lo:103: 00010000:00010000:3.0:1789545604.566989:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545604.566994:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bee11b200/0x64919c0f856c059e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c0597 expref: 20 pid: 5840 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.567003:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bee11b200/0x64919c0f856c059e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c0597 expref: 20 pid: 5840 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.567017:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bee11b200/0x64919c0f856c059e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c0597 expref: 20 pid: 5840 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.567042:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545604.567080:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454894464:12345-0@lo:103: Request processed in 104us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545604.567088:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789545604.567107:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789545604.567112:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:3311:x1876474454894592:12345-0@lo:103: 00010000:00010000:3.0:1789545604.567233:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545604.567240:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994c0217f800/0x64919c0f856c0574 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c056d expref: 18 pid: 5839 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.567247:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994c0217f800/0x64919c0f856c0574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c056d expref: 18 pid: 5839 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.567256:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994c0217f800/0x64919c0f856c0574 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c056d expref: 18 pid: 5839 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.567264:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545604.567288:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:3311:x1876474454894592:12345-0@lo:103: Request processed in 176us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545604.567293:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789545604.567517:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454894592:0@lo:103: 00000100:00100000:3.0:1789545604.567526:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454894464:0@lo:103: 00000100:00100000:3.0:1789545604.567569:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beb86ab1-4563-44b1-afd1-f08a43b0622e:3313:1876474454894720:0@lo:103: 00000100:00100000:3.0:1789545604.567594:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545604.567613:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789545604.567619:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beb86ab1-4563-44b1-afd1-f08a43b0622e:3313:1876474454894848:0@lo:103: 00000100:00100000:3.0:1789545604.567638:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545604.567660:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454894720 00000100:00100000:3.0:1789545604.567669:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454894720 00010000:00010000:3.0:1789545604.567683:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bee11ae00/0x64919c0f856c0558 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c0551 expref: 17 pid: 5839 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545604.567698:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454894848 00000100:00100000:3.0:1789545604.567701:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454894848 00010000:00010000:3.0:1789545604.567711:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bee11be00/0x64919c0f856c054a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c0543 expref: 18 pid: 5839 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545604.567726:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789545604.567732:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:3313:x1876474454894720:12345-0@lo:103: 00010000:00010000:3.0:1789545604.567739:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545604.567743:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bee11ae00/0x64919c0f856c0558 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c0551 expref: 18 pid: 5839 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.567751:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bee11ae00/0x64919c0f856c0558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c0551 expref: 18 pid: 5839 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.567762:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bee11ae00/0x64919c0f856c0558 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c0551 expref: 18 pid: 5839 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.567772:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545604.567800:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:3313:x1876474454894720:12345-0@lo:103: Request processed in 69us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545604.567806:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789545604.567817:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789545604.567821:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:3313:x1876474454894848:12345-0@lo:103: 00010000:00010000:3.0:1789545604.567829:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545604.567832:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bee11be00/0x64919c0f856c054a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c0543 expref: 16 pid: 5839 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.567849:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bee11be00/0x64919c0f856c054a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c0543 expref: 16 pid: 5839 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.567858:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bee11be00/0x64919c0f856c054a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c0543 expref: 16 pid: 5839 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.567866:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545604.567889:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:3313:x1876474454894848:12345-0@lo:103: Request processed in 68us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545604.567894:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789545604.567919:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beb86ab1-4563-44b1-afd1-f08a43b0622e:3313:1876474454894848:0@lo:103: 00000100:00100000:3.0:1789545604.567926:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beb86ab1-4563-44b1-afd1-f08a43b0622e:3313:1876474454894720:0@lo:103: 00010000:00010000:1.0:1789545604.568288:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:2.0:1789545604.568583:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789545604.568657:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bc0031800/0x64919c0f856c0535 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c053c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.568665:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789545604.568683:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bc0031800/0x64919c0f856c0535 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c053c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.568691:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bc0031800/0x64919c0f856c0535 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c053c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.568703:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789545604.568707:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c04e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c04e8 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.568713:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc0031e00 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:2.0:1789545604.568716:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c04e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c04e8 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.568724:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c04e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c04e8 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789545604.568730:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c04e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c04e8 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789545604.568734:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789545604.568804:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb43800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1876474454893312:192.168.201.16@tcp:104: 00000100:00100000:3.0:1789545604.568814:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb43480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1876474454893440:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545604.568850:0:8448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff994c0217e800/0x64919c0f856c05eb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545604.569993:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454894976:0@lo:103: 00000100:00100000:0.0:1789545604.570048:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545604.570759:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454894976 00000100:00100000:3.0:1789545604.570768:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454894976 00010000:00010000:3.0:1789545604.570800:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bc49d0400/0x64919c0f856c053c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c0535 expref: 15 pid: 5840 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545604.570828:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789545604.570836:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:3311:x1876474454894976:12345-0@lo:103: 00010000:00010000:3.0:1789545604.570850:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545604.570855:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bc49d0400/0x64919c0f856c053c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c0535 expref: 15 pid: 5840 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.570878:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bc49d0400/0x64919c0f856c053c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c0535 expref: 15 pid: 5840 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.570891:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc49d0400/0x64919c0f856c053c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c0535 expref: 15 pid: 5840 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.570905:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545604.570954:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:3311:x1876474454894976:12345-0@lo:103: Request processed in 119us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545604.570961:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789545604.571003:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454894976:0@lo:103: 00010000:00010000:0.0:1789545604.571108:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545604.571111:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545604.571112:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545604.571257:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bee11b000/0x64919c0f856c050b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c0512 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.571265:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bee11b000 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:3.0:1789545604.571269:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bee11b000/0x64919c0f856c050b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c0512 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.571279:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bee11b000/0x64919c0f856c050b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c0512 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789545604.571286:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bee11b000/0x64919c0f856c050b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c0512 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789545604.571291:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789545604.572937:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c04e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c04e8 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.572952:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789545604.572988:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c04e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c04e8 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.572996:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c04e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c04e8 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.573011:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545604.573013:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545604.573015:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545604.573041:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454895104:0@lo:103: 00000100:00100000:2.0:1789545604.573100:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545604.573183:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454895104 00000100:00100000:2.0:1789545604.573190:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454895104 00010000:00010000:2.0:1789545604.573214:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bc0030000/0x64919c0f856c04e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c04e1 expref: 14 pid: 5839 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545604.573242:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789545604.573250:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:3312:x1876474454895104:12345-0@lo:103: 00010000:00010000:2.0:1789545604.573264:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545604.573269:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bc0030000/0x64919c0f856c04e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c04e1 expref: 14 pid: 5839 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.573278:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bc0030000/0x64919c0f856c04e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c04e1 expref: 14 pid: 5839 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.573730:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc0030000/0x64919c0f856c04e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c04e1 expref: 14 pid: 5839 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.573750:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789545604.573794:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:3312:x1876474454895104:12345-0@lo:103: Request processed in 544us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545604.573808:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789545604.573847:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454895104:0@lo:103: 00010000:00010000:3.0:1789545604.574788:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bee11b000/0x64919c0f856c050b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0512 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.574800:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789545604.574834:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bee11b000/0x64919c0f856c050b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0512 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.574841:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bee11b000/0x64919c0f856c050b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0512 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.574860:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545604.574862:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545604.574864:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789545604.574873:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789545604.574887:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beb86ab1-4563-44b1-afd1-f08a43b0622e:3314:1876474454895232:0@lo:103: 00000100:00100000:3.0:1789545604.574933:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545604.575712:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545604.575735:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545604.575758:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454895232 00000100:00100000:2.0:1789545604.575765:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454895232 00010000:00010000:2.0:1789545604.575793:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bc49d1400/0x64919c0f856c0512 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c050b expref: 13 pid: 5838 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545604.575816:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438094848 00000100:00100000:2.0:1789545604.575819:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438094848 00010000:00010000:2.0:1789545604.575831:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bc49d0600/0x64919c0f856c05b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de52eb expref: 10 pid: 5838 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545604.575845:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438094976 00000100:00100000:2.0:1789545604.575848:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438094976 00010000:00010000:2.0:1789545604.575858:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bee11b800/0x64919c0f856c05ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de52e4 expref: 11 pid: 5839 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545604.575870:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789545604.575878:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd9367050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:3314:x1876474454895232:12345-0@lo:103: 00010000:00010000:2.0:1789545604.575890:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545604.575895:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bc49d1400/0x64919c0f856c0512 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c050b expref: 13 pid: 5838 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.575904:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bc49d1400/0x64919c0f856c0512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c050b expref: 13 pid: 5838 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.575918:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc49d1400/0x64919c0f856c0512 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c050b expref: 13 pid: 5838 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.575937:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789545604.575976:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd9367050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:3314:x1876474454895232:12345-0@lo:103: Request processed in 99us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545604.575983:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789545604.576023:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 19 00000100:00100000:2.0:1789545604.576042:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7941446-3286-4db8-8c2a-05ec7eed2433+11:2358:x1876474438094848:12345-192.168.201.16@tcp:103: 00010000:00010000:2.0:1789545604.576049:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545604.576054:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bc49d0600/0x64919c0f856c05b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de52eb expref: 11 pid: 5838 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.576064:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bc49d0600/0x64919c0f856c05b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de52eb expref: 11 pid: 5838 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.576074:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc49d0600/0x64919c0f856c05b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de52eb expref: 11 pid: 5838 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.576082:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789545604.576115:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7941446-3286-4db8-8c2a-05ec7eed2433+10:2358:x1876474438094848:12345-192.168.201.16@tcp:103: Request processed in 74us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545604.576134:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 19 00000100:00100000:2.0:1789545604.576147:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 20 00000100:00100000:2.0:1789545604.576153:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7941446-3286-4db8-8c2a-05ec7eed2433+9:2358:x1876474438094976:12345-192.168.201.16@tcp:103: 00010000:00010000:2.0:1789545604.576160:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545604.576164:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bee11b800/0x64919c0f856c05ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de52e4 expref: 9 pid: 5839 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.576182:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bee11b800/0x64919c0f856c05ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de52e4 expref: 9 pid: 5839 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.576192:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bee11b800/0x64919c0f856c05ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de52e4 expref: 9 pid: 5839 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.576204:0:7637:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff994c0217e800/0x64919c0f856c05eb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.576213:0:7637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994c0217e800/0x64919c0f856c05eb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.576228:0:7637:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994c0217e800/0x64919c0f856c05eb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.576235:0:7637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994c0217e800/0x64919c0f856c05eb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.576242:0:7637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff994c0217e800/0x64919c0f856c05eb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.576248:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff994c0217e800/0x64919c0f856c05eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.576253:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217e800 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:2.0:1789545604.576257:0:7637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff994c0217e800/0x64919c0f856c05eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.576264:0:7637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff994c0217e800/0x64919c0f856c05eb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.576284:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff994c0217e800/0x64919c0f856c05eb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545604.576293:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789545604.576311:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7941446-3286-4db8-8c2a-05ec7eed2433+8:2358:x1876474438094976:12345-192.168.201.16@tcp:103: Request processed in 158us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545604.576317:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 20 00000100:00100000:2.0:1789545604.576466:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beb86ab1-4563-44b1-afd1-f08a43b0622e:3314:1876474454895232:0@lo:103: 00010000:00010000:3.0:1789545604.577033:0:8448:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff994c0217e800/0x64919c0f856c05eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.577040:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff994c0217e800/0x64919c0f856c05eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545604.577044:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994c0217e800/0x64919c0f856c05eb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545604.924681:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545605.695796:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994becd91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454895744:0@lo:400: 00000100:00100000:0.0:1789545605.695886:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545605.695961:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789545605.695968:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994becd93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beb86ab1-4563-44b1-afd1-f08a43b0622e:3313:1876474454895360:0@lo:400: 00000100:00100000:0.0:1789545605.695998:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545605.696022:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994becd93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876474454895872:0@lo:400: 00000100:00100000:0.0:1789545605.696048:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545605.696078:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994becd90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454895488:0@lo:400: 00000100:00100000:0.0:1789545605.696101:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545605.696132:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994becd91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454896000:0@lo:400: 00000100:00100000:0.0:1789545605.696154:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545605.696171:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789545605.696177:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994becd90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876474454895616:0@lo:400: 00000100:00100000:0.0:1789545605.696198:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545605.696225:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454895872 00000100:00100000:0.0:1789545605.696234:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454895872 00000100:00100000:0.0:1789545605.696280:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454895488 00000100:00100000:0.0:1789545605.696283:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454895488 00000100:00100000:0.0:1789545605.696298:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454895616 00000100:00100000:0.0:1789545605.696301:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454895616 00000100:00100000:0.0:1789545605.696319:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789545605.696327:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876474454895872:12345-0@lo:400: 00000100:00100000:0.0:1789545605.696420:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876474454895872:12345-0@lo:400: Request processed in 93us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545605.696427:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789545605.696446:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789545605.696453:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454895488:12345-0@lo:400: 00000100:00100000:0.0:1789545605.696502:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454895488:12345-0@lo:400: Request processed in 50us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545605.696509:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789545605.696533:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789545605.696541:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876474454895616:12345-0@lo:400: 00000100:00100000:0.0:1789545605.696568:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876474454895616:12345-0@lo:400: Request processed in 29us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545605.696574:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789545605.696593:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454895744 00000100:00100000:0.0:1789545605.696597:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454895744 00000100:00100000:0.0:1789545605.696623:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454896000 00000100:00100000:0.0:1789545605.696625:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454896000 00000100:00100000:0.0:1789545605.696642:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789545605.696648:0:8211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454895744:12345-0@lo:400: 00000100:00100000:0.0:1789545605.696678:0:8211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454895744:12345-0@lo:400: Request processed in 30us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545605.696684:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789545605.696695:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789545605.696700:0:8211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454896000:12345-0@lo:400: 00000100:00100000:0.0:1789545605.696726:0:8211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454896000:12345-0@lo:400: Request processed in 26us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545605.696732:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1789545605.696751:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789545605.696755:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789545605.696757:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789545605.696789:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994becd90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876474454895616:0@lo:400: 00000100:00100000:0.0:1789545605.696801:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994becd90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454895488:0@lo:400: 00010000:00080000:0.0:1789545605.696821:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994becd91500 x1876474454896000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545605.696831:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994becd91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454896000:0@lo:400: 00000100:00100000:0.0:1789545605.696862:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994becd93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876474454895872:0@lo:400: 00010000:00080000:0.0:1789545605.696870:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994becd91880 x1876474454895744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545605.696878:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994becd91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454895744:0@lo:400: 00000100:00100000:3.0:1789545605.697213:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454895360 00000100:00100000:3.0:1789545605.697220:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454895360 00000100:00100000:3.0:1789545605.697260:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789545605.697268:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:3313:x1876474454895360:12345-0@lo:400: 00000100:00100000:3.0:1789545605.697318:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:3313:x1876474454895360:12345-0@lo:400: Request processed in 52us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545605.697324:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789545605.697389:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994becd93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beb86ab1-4563-44b1-afd1-f08a43b0622e:3313:1876474454895360:0@lo:400: 00010000:00010000:2.0:1789545605.950459:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789545605.950626:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789545605.950630:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff994bdfb06800 from 39 10000000:01000000:0.0:1789545605.950636:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789545605.950685:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0030a00/0x64919c0f856c05f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545605.950697:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc0030a00/0x64919c0f856c05f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545605.950823:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc0030a00/0x64919c0f856c05f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545605.950849:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454896128:0@lo:101: 00000100:00100000:0.0:1789545605.950922:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545605.950982:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994becce8900 going to sleep for 11 seconds 00000100:00100000:1.0:1789545605.951163:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454896128 00000100:00100000:1.0:1789545605.951172:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454896128 00000100:00100000:1.0:1789545605.951275:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789545605.951286:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+12:5843:x1876474454896128:12345-0@lo:101: 00010000:00010000:1.0:1789545605.951327:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545605.951343:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc8ba8600/0x64919c0f856c05f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c05f2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545605.951387:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc8ba8600/0x64919c0f856c05f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c05f2 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545605.951399:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc8ba8600/0x64919c0f856c05f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c05f2 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545605.951409:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba8600, rc 0) 00000100:00100000:1.0:1789545605.951461:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:5843:x1876474454896128:12345-0@lo:101: Request processed in 177us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545605.951469:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789545605.951562:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454896128:0@lo:101: 00010000:00010000:0.0:1789545605.951579:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc0030a00/0x64919c0f856c05f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c05f9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545605.951587:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc0030a00/0x64919c0f856c05f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c05f9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545605.951662:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454896256:0@lo:501: 00000100:00100000:0.0:1789545605.951687:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545605.963676:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994becce8900 going to sleep for 11 seconds 00000100:00100000:3.0:1789545605.968077:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454896256 00000100:00100000:3.0:1789545605.968113:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454896256 00000100:00100000:3.0:1789545605.968177:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789545605.968188:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:5843:x1876474454896256:12345-0@lo:501: 00000100:00100000:3.0:1789545605.968541:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:5843:x1876474454896256:12345-0@lo:501: Request processed in 354us (16851us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545605.968548:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789545605.968947:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454896256:0@lo:501: 00000100:00100000:0.0:1789545605.968999:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454896384:0@lo:503: 00000100:00100000:0.0:1789545605.969048:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545605.969089:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994becce8900 going to sleep for 11 seconds 00000100:00100000:3.0:1789545605.969143:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454896384 00000100:00100000:3.0:1789545605.969148:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454896384 00000100:00100000:3.0:1789545605.969178:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789545605.969185:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:5843:x1876474454896384:12345-0@lo:503: 00000100:00100000:3.0:1789545605.969339:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:5843:x1876474454896384:12345-0@lo:503: Request processed in 154us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545605.969346:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789545605.969523:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454896384:0@lo:503: 00000100:00100000:3.0:1789545605.971724:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb43800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8465:1876474454896512:0@lo:502: 00000100:00100000:3.0:1789545605.971800:0:8465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545605.971850:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff994becff1000 going to sleep for 11 seconds 00000100:00100000:0.0:1789545605.971902:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454896512 00000100:00100000:0.0:1789545605.971909:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454896512 00000100:00100000:0.0:1789545605.971955:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789545605.971963:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:8465:x1876474454896512:12345-0@lo:502: 00000100:00100000:0.0:1789545605.972202:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:8465:x1876474454896512:12345-0@lo:502: Request processed in 239us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545605.972209:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789545605.972347:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb43800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8465:1876474454896512:0@lo:502: 00000100:00100000:3.0:1789545605.972412:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb43800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8465:1876474454896640:0@lo:502: 00000100:00100000:3.0:1789545605.972440:0:8465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545605.972468:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff994becff1000 going to sleep for 11 seconds 00000100:00100000:1.0:1789545605.972649:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454896640 00000100:00100000:1.0:1789545605.972654:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454896640 00000100:00100000:1.0:1789545605.972683:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789545605.972690:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:8465:x1876474454896640:12345-0@lo:502: 00000100:00100000:1.0:1789545605.972823:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:8465:x1876474454896640:12345-0@lo:502: Request processed in 133us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545605.972829:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789545605.972900:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb43800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8465:1876474454896640:0@lo:502: 00000040:00080000:3.0:1789545605.972917:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789545605.973080:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789545605.973098:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789545605.973109:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0030a00/0x64919c0f856c05f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c05f9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545605.973121:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc0030a00/0x64919c0f856c05f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c05f9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789545605.973142:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789545605.973144:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1789545605.973147:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789545605.973170:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8c00/0x64919c0f856c0600 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545605.973179:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8c00/0x64919c0f856c0600 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545605.973189:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8c00/0x64919c0f856c0600 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545605.973201:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994becd90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454896768:0@lo:101: 00000100:00100000:1.0:1789545605.973226:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545605.973286:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8e74480 going to sleep for 11 seconds 00000100:00100000:2.0:1789545605.974676:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454896768 00000100:00100000:2.0:1789545605.974687:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454896768 00000100:00100000:2.0:1789545605.974794:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789545605.974803:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+13:5843:x1876474454896768:12345-0@lo:101: 00010000:00010000:2.0:1789545605.974817:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545605.974833:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc49d0600/0x64919c0f856c0607 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c0600 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545605.974856:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc49d0600/0x64919c0f856c0607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c0600 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545605.974866:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc49d0600/0x64919c0f856c0607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0600 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545605.974875:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0600, rc 0) 00000100:00100000:2.0:1789545605.975039:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:5843:x1876474454896768:12345-0@lo:101: Request processed in 236us (1811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545605.975046:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789545605.975279:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994becd90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454896768:0@lo:101: 00010000:00010000:3.0:1789545605.975496:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8c00/0x64919c0f856c0600 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0607 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545605.975667:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8c00/0x64919c0f856c0600 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c0607 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545605.977174:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454896896:0@lo:501: 00000100:00100000:2.0:1789545605.977240:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545605.977345:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8db10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789545605.977912:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454896896 00000100:00100000:1.0:1789545605.977920:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454896896 00000100:00100000:1.0:1789545605.977970:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789545605.977979:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:5843:x1876474454896896:12345-0@lo:501: 00000100:00100000:1.0:1789545605.980469:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:5843:x1876474454896896:12345-0@lo:501: Request processed in 2484us (3222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545605.980481:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789545605.980830:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454896896:0@lo:501: 00000100:00100000:2.0:1789545605.989011:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454897024:0@lo:503: 00000100:00100000:2.0:1789545605.989112:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545605.989156:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8db1240 going to sleep for 11 seconds 00000100:00100000:0.0:1789545605.989482:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454897024 00000100:00100000:0.0:1789545605.989491:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454897024 00000100:00100000:0.0:1789545605.989573:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789545605.989582:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:5843:x1876474454897024:12345-0@lo:503: 00000100:00100000:0.0:1789545605.989814:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:5843:x1876474454897024:12345-0@lo:503: Request processed in 232us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545605.989822:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789545605.989935:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454897024:0@lo:503: 00000100:00100000:1.0:1789545605.990799:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994becd91f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8466:1876474454897152:0@lo:502: 00000100:00100000:1.0:1789545605.990848:0:8466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545605.990884:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bfbcb8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789545605.990983:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454897152 00000100:00100000:0.0:1789545605.990990:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454897152 00000100:00100000:0.0:1789545605.991028:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789545605.991036:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:8466:x1876474454897152:12345-0@lo:502: 00000100:00100000:0.0:1789545605.991207:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:8466:x1876474454897152:12345-0@lo:502: Request processed in 171us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545605.991213:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789545605.991354:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994becd91f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8466:1876474454897152:0@lo:502: 00000020:01000000:1.0:1789545605.991416:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789545605.991425:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789545605.991427:0:8466:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789545605.991434:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789545605.991456:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994becd91f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8466:1876474454897280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789545605.991491:0:8466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545605.991523:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bfbcb8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789545605.991738:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454897280 00000100:00100000:0.0:1789545605.991742:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454897280 00000100:00100000:0.0:1789545605.991775:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789545605.991782:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:8466:x1876474454897280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789545605.991922:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:8466:x1876474454897280:12345-0@lo:502:llog_process_th.0 Request processed in 139us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545605.991930:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789545605.992080:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994becd91f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8466:1876474454897280:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789545605.992102:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789545605.992107:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789545605.992109:0:8466:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789545605.992113:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789545605.992818:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1789545605.992840:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789545605.992850:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8c00/0x64919c0f856c0600 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0607 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545605.992862:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8c00/0x64919c0f856c0600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0607 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789545605.992873:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789545605.992876:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff994bc8231800 from 39 10000000:01000000:0.0:1789545605.992879:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789545605.992908:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0030e00/0x64919c0f856c060e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545605.992917:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc0030e00/0x64919c0f856c060e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545605.992941:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc0030e00/0x64919c0f856c060e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545605.992960:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454897408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789545605.993000:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545605.993039:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc8bab600 going to sleep for 11 seconds 00000100:00100000:1.0:1789545605.993088:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454897408 00000100:00100000:1.0:1789545605.993095:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454897408 00000100:00100000:1.0:1789545605.993132:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789545605.993141:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:5843:x1876474454897408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789545605.993151:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545605.993164:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc8ba8e00/0x64919c0f856c0615 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c060e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545605.993185:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc8ba8e00/0x64919c0f856c0615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c060e expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545605.993194:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc8ba8e00/0x64919c0f856c0615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c060e expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545605.993203:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba8e00, rc 0) 00000100:00100000:1.0:1789545605.993249:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:5843:x1876474454897408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545605.993277:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789545605.993850:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454897408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789545605.993866:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc0030e00/0x64919c0f856c060e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0615 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545605.993876:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc0030e00/0x64919c0f856c060e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c0615 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545605.993928:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454897536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789545605.993959:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545605.993992:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc8bab600 going to sleep for 11 seconds 00000100:00100000:2.0:1789545605.994144:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454897536 00000100:00100000:2.0:1789545605.994150:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454897536 00000100:00100000:2.0:1789545605.994184:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789545605.994191:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:5843:x1876474454897536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789545605.994470:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:5843:x1876474454897536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 279us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545605.994477:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789545605.994742:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454897536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789545605.994774:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454897664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789545605.994815:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545605.994848:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc8bab600 going to sleep for 11 seconds 00000100:00100000:1.0:1789545605.994931:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454897664 00000100:00100000:1.0:1789545605.994936:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454897664 00000100:00100000:1.0:1789545605.994971:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789545605.994979:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:5843:x1876474454897664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789545605.995120:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:5843:x1876474454897664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545605.995127:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789545605.995461:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454897664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789545605.996010:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8467:1876474454897792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789545605.996048:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545605.996076:0:8467:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc8bab180 going to sleep for 11 seconds 00000100:00100000:1.0:1789545605.996121:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454897792 00000100:00100000:1.0:1789545605.996125:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454897792 00000100:00100000:1.0:1789545605.996153:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789545605.996160:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:8467:x1876474454897792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789545605.996325:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:8467:x1876474454897792:12345-0@lo:502:llog_process_th.0 Request processed in 164us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545605.996332:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789545605.996430:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8467:1876474454897792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789545605.996472:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8467:1876474454897920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789545605.996524:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545605.996548:0:8467:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc8bab180 going to sleep for 11 seconds 00000100:00100000:2.0:1789545605.996691:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454897920 00000100:00100000:2.0:1789545605.996695:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454897920 00000100:00100000:2.0:1789545605.996725:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789545605.996732:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8dde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:8467:x1876474454897920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789545605.996878:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8dde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:8467:x1876474454897920:12345-0@lo:502:llog_process_th.0 Request processed in 146us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545605.996885:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789545605.997023:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8467:1876474454897920:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789545605.997042:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789545605.997201:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789545605.997224:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789545605.997233:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0030e00/0x64919c0f856c060e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0615 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545605.997245:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc0030e00/0x64919c0f856c060e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0615 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789545605.997267:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789545605.997269:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1789545605.997272:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789545605.997296:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d1400/0x64919c0f856c061c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545605.997305:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc49d1400/0x64919c0f856c061c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545605.997313:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc49d1400/0x64919c0f856c061c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545605.997327:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454898048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789545605.997355:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545605.997405:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8db1240 going to sleep for 11 seconds 00000100:00100000:0.0:1789545605.997494:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454898048 00000100:00100000:0.0:1789545605.997499:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454898048 00000100:00100000:0.0:1789545605.997549:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789545605.997555:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:5843:x1876474454898048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789545605.997564:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545605.997576:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc0030000/0x64919c0f856c0623 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c061c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545605.997750:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc0030000/0x64919c0f856c0623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c061c expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545605.997763:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc0030000/0x64919c0f856c0623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c061c expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545605.997772:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc0030000, rc 0) 00000100:00100000:0.0:1789545605.997802:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:5843:x1876474454898048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 247us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545605.997809:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789545605.997924:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454898048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789545605.997938:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc49d1400/0x64919c0f856c061c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0623 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545605.997946:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc49d1400/0x64919c0f856c061c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c0623 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545605.997990:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454898176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789545605.998014:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545605.998044:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8db1240 going to sleep for 11 seconds 00000100:00100000:3.0:1789545605.998091:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454898176 00000100:00100000:3.0:1789545605.998096:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454898176 00000100:00100000:3.0:1789545605.998128:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789545605.998135:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:5843:x1876474454898176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789545605.998407:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:5843:x1876474454898176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 271us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545605.998414:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789545605.998549:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454898176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789545605.998579:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454898304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789545605.998637:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545605.998666:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8db1240 going to sleep for 11 seconds 00000100:00100000:1.0:1789545605.998962:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454898304 00000100:00100000:1.0:1789545605.998968:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454898304 00000100:00100000:1.0:1789545605.999007:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789545605.999015:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:5843:x1876474454898304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789545605.999164:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:5843:x1876474454898304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545605.999171:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789545605.999821:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454898304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789545606.000172:0:8468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8468:1876474454898432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789545606.000221:0:8468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545606.000257:0:8468:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8db1900 going to sleep for 11 seconds 00000100:00100000:1.0:1789545606.000300:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454898432 00000100:00100000:1.0:1789545606.000306:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454898432 00000100:00100000:1.0:1789545606.000342:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789545606.000349:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:8468:x1876474454898432:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789545606.000747:0:8468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8468:1876474454898432:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789545606.000771:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789545606.000779:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545606.000781:0:8468:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789545606.000788:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789545606.000807:0:8468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8468:1876474454898560:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789545606.000844:0:8468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545606.000870:0:8468:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8db1900 going to sleep for 11 seconds 00000100:00100000:1.0:1789545606.000905:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:8468:x1876474454898432:12345-0@lo:502:llog_process_th.0 Request processed in 240us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545606.000915:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789545606.000945:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454898560 00000100:00100000:1.0:1789545606.000949:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454898560 00000100:00100000:1.0:1789545606.000966:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789545606.000972:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:8468:x1876474454898560:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789545606.001179:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:8468:x1876474454898560:12345-0@lo:502:llog_process_th.0 Request processed in 206us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545606.001186:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789545606.004589:0:8468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8468:1876474454898560:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789545606.004655:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789545606.004666:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545606.004668:0:8468:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789545606.004674:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1789545606.004941:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1789545606.004964:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789545606.004976:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d1400/0x64919c0f856c061c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0623 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545606.004988:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc49d1400/0x64919c0f856c061c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0623 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789545606.005000:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789545606.005003:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff994bc4a49800 from 39 10000000:01000000:1.0:1789545606.005006:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789545606.005042:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8a00/0x64919c0f856c062a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545606.005051:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8a00/0x64919c0f856c062a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545606.005061:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8a00/0x64919c0f856c062a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545606.005095:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994becd91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454898688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789545606.005158:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545606.005193:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bfbcb8180 going to sleep for 11 seconds 00000100:00100000:3.0:1789545606.005267:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454898688 00000100:00100000:3.0:1789545606.005275:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454898688 00000100:00100000:3.0:1789545606.005333:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789545606.005346:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:5843:x1876474454898688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789545606.005399:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545606.005415:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994c0217e800/0x64919c0f856c0631 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c062a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545606.005441:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994c0217e800/0x64919c0f856c0631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c062a expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545606.005453:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994c0217e800/0x64919c0f856c0631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c062a expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545606.005462:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217e800, rc 0) 00000100:00100000:3.0:1789545606.005537:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:5843:x1876474454898688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545606.005545:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789545606.005748:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994becd91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454898688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789545606.005765:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8a00/0x64919c0f856c062a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0631 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545606.005774:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8a00/0x64919c0f856c062a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c0631 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545606.005843:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454898816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789545606.005871:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545606.005907:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8db1900 going to sleep for 11 seconds 00000100:00100000:0.0:1789545606.005952:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454898816 00000100:00100000:0.0:1789545606.005957:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454898816 00000100:00100000:0.0:1789545606.005982:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789545606.005989:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:5843:x1876474454898816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789545606.006324:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:5843:x1876474454898816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 335us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545606.006333:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789545606.006547:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454898816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789545606.006578:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454898944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789545606.006705:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545606.006733:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8db1900 going to sleep for 11 seconds 00000100:00100000:1.0:1789545606.006773:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454898944 00000100:00100000:1.0:1789545606.006778:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454898944 00000100:00100000:1.0:1789545606.006813:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789545606.006820:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:5843:x1876474454898944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789545606.006978:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:5843:x1876474454898944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545606.006985:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789545606.007201:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454898944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789545606.007748:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8469:1876474454899072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789545606.007793:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545606.007829:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8db10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789545606.007880:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454899072 00000100:00100000:3.0:1789545606.007885:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454899072 00000100:00100000:3.0:1789545606.007922:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789545606.007931:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:8469:x1876474454899072:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789545606.008135:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:8469:x1876474454899072:12345-0@lo:502:llog_process_th.0 Request processed in 205us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545606.008143:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789545606.008222:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8469:1876474454899072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789545606.008264:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8469:1876474454899200:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789545606.008296:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545606.008321:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc4a63a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789545606.008389:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454899200 00000100:00100000:0.0:1789545606.008395:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454899200 00000100:00100000:0.0:1789545606.008428:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789545606.008435:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:8469:x1876474454899200:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789545606.008580:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:8469:x1876474454899200:12345-0@lo:502:llog_process_th.0 Request processed in 145us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545606.008587:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789545606.008782:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8469:1876474454899200:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789545606.008803:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789545606.008945:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1789545606.008962:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789545606.008971:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8a00/0x64919c0f856c062a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0631 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545606.008982:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8a00/0x64919c0f856c062a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0631 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789545606.008991:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789545606.008994:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1789545606.008996:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789545606.009022:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994c0217f800/0x64919c0f856c0638 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545606.009030:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994c0217f800/0x64919c0f856c0638 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545606.009038:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994c0217f800/0x64919c0f856c0638 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545606.009063:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454899328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789545606.009091:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545606.009124:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994becff1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789545606.009185:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454899328 00000100:00100000:1.0:1789545606.009190:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454899328 00000100:00100000:1.0:1789545606.009223:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789545606.009230:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:5843:x1876474454899328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789545606.009239:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545606.009251:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc8ba8000/0x64919c0f856c063f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c0638 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545606.009271:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc8ba8000/0x64919c0f856c063f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c0638 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545606.009280:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc8ba8000/0x64919c0f856c063f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0638 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545606.009288:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba8000, rc 0) 00000100:00100000:1.0:1789545606.009328:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:5843:x1876474454899328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545606.009340:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789545606.009480:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454899328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789545606.009494:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994c0217f800/0x64919c0f856c0638 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c063f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545606.009503:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994c0217f800/0x64919c0f856c0638 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c063f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545606.009563:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454899456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789545606.009588:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545606.009724:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8db10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789545606.009761:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454899456 00000100:00100000:1.0:1789545606.009766:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454899456 00000100:00100000:1.0:1789545606.009823:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789545606.009831:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:5843:x1876474454899456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789545606.010062:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:5843:x1876474454899456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545606.010069:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789545606.010125:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454899456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789545606.010152:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454899584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789545606.010187:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545606.011023:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8db10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789545606.011114:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454899584 00000100:00100000:0.0:1789545606.011122:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454899584 00000100:00100000:0.0:1789545606.011154:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789545606.011162:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:5843:x1876474454899584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789545606.011339:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:5843:x1876474454899584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545606.011347:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789545606.011479:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454899584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789545606.012003:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8470:1876474454899712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789545606.012043:0:8470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545606.012069:0:8470:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8db10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789545606.012107:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454899712 00000100:00100000:0.0:1789545606.012113:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454899712 00000100:00100000:0.0:1789545606.012134:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789545606.012140:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:8470:x1876474454899712:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789545606.012308:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:8470:x1876474454899712:12345-0@lo:502:llog_process_th.0 Request processed in 167us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545606.012315:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789545606.012406:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8470:1876474454899712:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789545606.012432:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789545606.012441:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545606.012444:0:8470:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789545606.012450:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789545606.012473:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8470:1876474454899840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789545606.012504:0:8470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545606.012531:0:8470:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfae03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789545606.012582:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454899840 00000100:00100000:0.0:1789545606.012586:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454899840 00000100:00100000:0.0:1789545606.012621:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789545606.012627:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:8470:x1876474454899840:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789545606.012769:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:8470:x1876474454899840:12345-0@lo:502:llog_process_th.0 Request processed in 141us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545606.012776:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789545606.012879:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8470:1876474454899840:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789545606.012898:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789545606.012902:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545606.012903:0:8470:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789545606.012911:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1789545606.013104:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1789545606.013121:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789545606.013129:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994c0217f800/0x64919c0f856c0638 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c063f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545606.013139:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994c0217f800/0x64919c0f856c0638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c063f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789545606.013149:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789545606.013151:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff994bc65dcd40 from 1 10000000:01000000:0.0:1789545606.013154:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789545606.013178:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c0646 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545606.013187:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c0646 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545606.013195:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c0646 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545606.013209:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454899968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789545606.013235:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545606.013257:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994ac2b53240 going to sleep for 11 seconds 00000100:00100000:2.0:1789545606.013297:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454899968 00000100:00100000:2.0:1789545606.013302:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454899968 00000100:00100000:2.0:1789545606.013322:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789545606.013328:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:5843:x1876474454899968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789545606.013335:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545606.013348:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc49d0e00/0x64919c0f856c064d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c0646 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545606.013400:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc49d0e00/0x64919c0f856c064d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c0646 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545606.013410:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc49d0e00/0x64919c0f856c064d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0646 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545606.013419:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0e00, rc 0) 00000100:00100000:2.0:1789545606.013453:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:5843:x1876474454899968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545606.013459:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789545606.013539:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454899968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789545606.013559:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c0646 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c064d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545606.013569:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c0646 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c064d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545606.013621:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454900096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789545606.013643:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545606.013826:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994ac2b53240 going to sleep for 11 seconds 00000100:00100000:1.0:1789545606.013875:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454900096 00000100:00100000:1.0:1789545606.013880:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454900096 00000100:00100000:2.0:1789545606.013923:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789545606.013931:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:5843:x1876474454900096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789545606.014135:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:5843:x1876474454900096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 204us (490us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789545606.014142:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789545606.014262:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454900096:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789545606.014287:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789545606.014294:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c0646 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c064d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545606.014301:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c0646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c064d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545606.204568:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789545606.204602:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454900352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789545606.204634:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994becd92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454900224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789545606.204678:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545606.204897:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454900352 00000100:00100000:1.0:1789545606.204906:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454900352 00000100:00100000:1.0:1789545606.204962:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789545606.204973:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454900352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789545606.205009:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789545606.205060:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454900352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545606.205066:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1789545606.205160:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be518ea00 x1876474454900352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545622 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545606.205191:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454900352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789545606.205330:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545606.205456:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454900224 00000100:00100000:1.0:1789545606.205461:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454900224 00000100:00100000:1.0:1789545606.205492:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789545606.205499:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454900224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789545606.205531:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789545606.205594:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454900224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545606.205599:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1789545606.206091:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994becd92d80 x1876474454900224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545622 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545606.206106:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994becd92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454900224:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789545606.972627:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545607.090005:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545607.090075:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438095104 00000100:00100000:3.0:1789545607.090084:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438095104 00000100:00100000:3.0:1789545607.090137:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 163 00000100:00100000:3.0:1789545607.090144:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+8:2358:x1876474438095104:12345-192.168.201.16@tcp:400: 00000100:00100000:3.0:1789545607.090217:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+8:2358:x1876474438095104:12345-192.168.201.16@tcp:400: Request processed in 74us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545607.090222:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 163 00000100:00100000:2.0:1789545607.095050:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545607.095129:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545607.095210:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545607.095299:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438095488 00000100:00100000:1.0:1789545607.095308:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438095488 00000100:00100000:1.0:1789545607.095389:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438095360 00000100:00100000:1.0:1789545607.095392:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438095360 00000100:00100000:1.0:1789545607.095423:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12 00000100:00100000:1.0:1789545607.095433:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+5:2359:x1876474438095488:12345-192.168.201.16@tcp:400: 00000100:00100000:1.0:1789545607.095521:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+5:2359:x1876474438095488:12345-192.168.201.16@tcp:400: Request processed in 65us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545607.095528:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12 00000100:00100000:1.0:1789545607.095544:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 13 00000100:00100000:1.0:1789545607.095550:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+5:2359:x1876474438095360:12345-192.168.201.16@tcp:400: 00000100:00100000:1.0:1789545607.095579:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+5:2359:x1876474438095360:12345-192.168.201.16@tcp:400: Request processed in 21us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545607.095585:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 13 00000100:00080000:2.0:1789545607.097211:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789545607.097218:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789545607.101141:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438095232 00000100:00100000:0.0:1789545607.101157:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438095232 00000100:00100000:0.0:1789545607.101252:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 27 00000100:00100000:0.0:1789545607.101285:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+6:2359:x1876474438095232:12345-192.168.201.16@tcp:400: 00000100:00100000:0.0:1789545607.101800:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+6:2359:x1876474438095232:12345-192.168.201.16@tcp:400: Request processed in 523us (6754us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545607.101809:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 27 00000100:00080000:2.0:1789545607.102044:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789545607.996615:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545609.021059:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545610.044918:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545610.162428:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545610.162524:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438095616 00000100:00100000:0.0:1789545610.162534:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438095616 00000100:00100000:0.0:1789545610.162595:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 164 00000100:00100000:0.0:1789545610.162604:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+8:5596:x1876474438095616:12345-192.168.201.16@tcp:101: 00010000:00010000:0.0:1789545610.162621:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545610.162640:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc0031600/0x64919c0f856c0654 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de534d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545610.162669:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc0031600/0x64919c0f856c0654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de534d expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545610.162680:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc0031600/0x64919c0f856c0654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de534d expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545610.162688:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc0031600, rc 0) 00000100:00100000:0.0:1789545610.164310:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+9:5596:x1876474438095616:12345-192.168.201.16@tcp:101: Request processed in 1699us (1884us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545610.164321:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 164 00000100:00100000:3.0:1789545610.169959:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545610.170114:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438095744 00000100:00100000:1.0:1789545610.170125:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438095744 00000100:00100000:1.0:1789545610.170269:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 165 00000100:00100000:1.0:1789545610.170281:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+9:5596:x1876474438095744:12345-192.168.201.16@tcp:501: 00000100:00100000:1.0:1789545610.170657:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+9:5596:x1876474438095744:12345-192.168.201.16@tcp:501: Request processed in 377us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545610.170666:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 165 00000100:00100000:1.0:1789545610.177672:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545610.177763:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438095872 00000100:00100000:0.0:1789545610.177772:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438095872 00000100:00100000:0.0:1789545610.177824:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 166 00000100:00100000:0.0:1789545610.177833:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+9:5596:x1876474438095872:12345-192.168.201.16@tcp:503: 00000100:00100000:0.0:1789545610.178072:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+9:5596:x1876474438095872:12345-192.168.201.16@tcp:503: Request processed in 238us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545610.178080:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 166 00000100:00100000:2.0:1789545610.185713:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545610.185797:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438096000 00000100:00100000:3.0:1789545610.185807:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438096000 00000100:00100000:3.0:1789545610.185863:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 167 00000100:00100000:3.0:1789545610.185875:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+9:6093:x1876474438096000:12345-192.168.201.16@tcp:502: 00000100:00100000:3.0:1789545610.186160:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+9:6093:x1876474438096000:12345-192.168.201.16@tcp:502: Request processed in 286us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545610.186168:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 167 00000100:00100000:3.0:1789545610.191287:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545610.191384:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438096128 00000100:00100000:1.0:1789545610.191394:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438096128 00000100:00100000:1.0:1789545610.191455:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 168 00000100:00100000:1.0:1789545610.191466:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+9:6093:x1876474438096128:12345-192.168.201.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789545610.191777:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+9:6093:x1876474438096128:12345-192.168.201.16@tcp:502:llog_process_th.0 Request processed in 311us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545610.191785:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 168 00000100:00100000:1.0:1789545610.196820:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545610.201889:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438096256 00000100:00100000:0.0:1789545610.201906:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438096256 00000100:00100000:0.0:1789545610.201973:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 169 00000100:00100000:0.0:1789545610.201984:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+9:5596:x1876474438096256:12345-192.168.201.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789545610.202001:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545610.202146:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc0031400/0x64919c0f856c065b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5354 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545610.202346:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc0031400/0x64919c0f856c065b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5354 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545610.202376:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc0031400/0x64919c0f856c065b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5354 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545610.202385:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc0031400, rc 0) 00000100:00100000:0.0:1789545610.202462:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+10:5596:x1876474438096256:12345-192.168.201.16@tcp:101:ll_cfg_requeue.0 Request processed in 479us (5652us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545610.202470:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 169 00000100:00100000:2.0:1789545610.214096:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545610.214194:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438096384 00000100:00100000:3.0:1789545610.214205:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438096384 00000100:00100000:3.0:1789545610.214353:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 170 00000100:00100000:3.0:1789545610.214399:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+10:5596:x1876474438096384:12345-192.168.201.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789545610.214671:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+10:5596:x1876474438096384:12345-192.168.201.16@tcp:501:ll_cfg_requeue.0 Request processed in 273us (642us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789545610.214679:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 170 00000100:00100000:0.0:1789545610.814462:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454900864:0@lo:400:kworker.0 00000100:00100000:0.0:1789545610.814532:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545610.814596:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789545610.814603:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beb86ab1-4563-44b1-afd1-f08a43b0622e:3313:1876474454900480:0@lo:400:kworker.0 00000100:00100000:0.0:1789545610.814634:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545610.814672:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876474454900992:0@lo:400:kworker.0 00000100:00100000:0.0:1789545610.814697:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545610.814722:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454900608:0@lo:400:kworker.0 00000100:00100000:0.0:1789545610.814744:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545610.814761:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454901120:0@lo:400:kworker.0 00000100:00100000:0.0:1789545610.814782:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545610.814798:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789545610.814803:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876474454900736:0@lo:400:kworker.0 00000100:00100000:0.0:1789545610.814836:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545610.814864:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454900992 00000100:00100000:0.0:1789545610.814871:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454900992 00000100:00100000:0.0:1789545610.814914:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454900608 00000100:00100000:0.0:1789545610.814918:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454900608 00000100:00100000:0.0:1789545610.814928:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454900736 00000100:00100000:0.0:1789545610.814930:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454900736 00000100:00100000:0.0:1789545610.814943:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789545610.814951:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876474454900992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545610.815077:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876474454900992:12345-0@lo:400:kworker.0 Request processed in 126us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545610.815085:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789545610.815102:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789545610.815108:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454900608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545610.815139:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454900608:12345-0@lo:400:kworker.0 Request processed in 32us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545610.815145:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789545610.815157:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789545610.815171:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876474454900736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545610.815206:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876474454900736:12345-0@lo:400:kworker.0 Request processed in 44us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545610.815768:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789545610.815794:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454900480 00000100:00100000:0.0:1789545610.815800:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454900480 00000100:00100000:0.0:1789545610.815824:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789545610.815831:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3313:x1876474454900480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545610.815867:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3313:x1876474454900480:12345-0@lo:400:kworker.0 Request processed in 36us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545610.815872:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789545610.815920:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876474454900736:0@lo:400:kworker.0 00000100:00100000:0.0:1789545610.815930:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454900608:0@lo:400:kworker.0 00000100:00100000:0.0:1789545610.815958:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beb86ab1-4563-44b1-afd1-f08a43b0622e:3313:1876474454900480:0@lo:400:kworker.0 00000100:00100000:0.0:1789545610.815969:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876474454900992:0@lo:400:kworker.0 00000100:00080000:3.0:1789545610.816122:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789545610.816392:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454900864 00000100:00100000:1.0:1789545610.816398:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454900864 00000100:00100000:1.0:1789545610.816449:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454901120 00000100:00100000:1.0:1789545610.816453:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454901120 00000100:00100000:1.0:1789545610.816478:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789545610.816486:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454900864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545610.816534:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454900864:12345-0@lo:400:kworker.0 Request processed in 50us (2003us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545610.816541:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789545610.816554:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789545610.816560:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454901120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545610.816593:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454901120:12345-0@lo:400:kworker.0 Request processed in 33us (1810us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545610.816599:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1789545610.816625:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789545610.816628:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789545610.817122:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be4ed5f80 x1876474454901120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545610.817135:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454901120:0@lo:400:kworker.0 00010000:00080000:0.0:1789545610.817166:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be4ed5500 x1876474454900864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545610.817176:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454900864:0@lo:400:kworker.0 00010000:00010000:0.0:1789545611.073055:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545611.324859:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789545611.324872:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994becd92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454901248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789545611.324878:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454901376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789545611.326433:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545611.326724:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545611.326849:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454901376 00000100:00100000:2.0:1789545611.326869:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454901376 00000100:00100000:2.0:1789545611.326908:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454901248 00000100:00100000:2.0:1789545611.326911:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454901248 00000100:00100000:2.0:1789545611.326926:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789545611.326935:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454901376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789545611.327244:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789545611.327320:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454901376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 385us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545611.327329:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789545611.327348:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789545611.327354:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454901248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789545611.327410:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789545611.327457:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454901248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545611.327479:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789545611.327565:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bc9c8ca80 x1876474454901376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545627 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545611.327583:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454901376:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789545611.327685:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994becd92680 x1876474454901248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545627 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545611.327701:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994becd92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454901248:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789545612.095135:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789545612.100657:0:8511:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc12c8ae0 20000000:00000080:0.0:1789545612.100680:0:8511:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff994bdf497000 uarg=0000000000000000 20000000:01000000:0.0:1789545612.100717:0:8511:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789545612.100724:0:8511:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789545612.100729:0:8511:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789545612.102140:0:8512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1789545612.102297:0:8511:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1789545612.108248:0:8511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1789545612.108458:0:8511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1789545612.108529:0:8511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1789545612.108547:0:8511:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789545612.108567:0:8511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff994bc0031800/0x64919c0f856c0662 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545612.108586:0:8511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994c0217ee00/0x64919c0f856c03d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c03d0 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545612.108594:0:8511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994c0217fa00/0x64919c0f856c0439 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0432 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545612.108602:0:8511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bee11ba00/0x64919c0f856c0504 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c04fd expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545612.108613:0:8511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bc49d1600/0x64919c0f856c05c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de531c expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545612.108621:0:8511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff994bc0031800/0x64919c0f856c0662 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545612.108670:0:8511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bc49d1600/0x64919c0f856c05c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de531c expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545612.108687:0:8511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994bc49d1600/0x64919c0f856c05c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de531c expref: 9 pid: 5839 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545612.108702:0:8511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c8ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1876474454901504:192.168.201.16@tcp:104: 00010000:00010000:0.0:1789545612.108813:0:8511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bee11ba00/0x64919c0f856c0504 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c04fd expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545612.108822:0:8511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994bee11ba00/0x64919c0f856c0504 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c04fd expref: 18 pid: 5840 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545612.108831:0:8511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c8fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1876474454901632:0@lo:104: 00000100:00100000:0.0:1789545612.108871:0:8511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789545612.108910:0:8511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994c0217fa00/0x64919c0f856c0439 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c0432 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545612.108919:0:8511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994c0217fa00/0x64919c0f856c0439 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c0432 expref: 18 pid: 5840 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545612.108928:0:8511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c8c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1876474454901760:0@lo:104: 00000100:00100000:0.0:1789545612.108953:0:8511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789545612.110473:0:8511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994c0217ee00/0x64919c0f856c03d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c03d0 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545612.110488:0:8511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994c0217ee00/0x64919c0f856c03d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c03d0 expref: 18 pid: 5838 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545612.110519:0:8511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c8df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1876474454901888:0@lo:104: 00000100:00100000:0.0:1789545612.110557:0:8511:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd9321540 going to sleep for 11 seconds 00000100:00100000:3.0:1789545612.110785:0:7635:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789545612.111342:0:7635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545612.111402:0:7635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454901632 00000100:00100000:3.0:1789545612.111419:0:7635:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454901632 00000100:00100000:3.0:1789545612.111458:0:7635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454901760 00000100:00100000:3.0:1789545612.111462:0:7635:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454901760 00000100:00100000:3.0:1789545612.111473:0:7635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454901888 00000100:00100000:3.0:1789545612.111475:0:7635:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454901888 00000100:00100000:3.0:1789545612.111488:0:7635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789545612.111496:0:7635:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:beb86ab1-4563-44b1-afd1-f08a43b0622e+5:8511:x1876474454901632:12345-0@lo:104: 00010000:00010000:3.0:1789545612.111510:0:7635:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994bc49d1800/0x64919c0f856c04fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c0504 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545612.111578:0:7635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789545612.111584:0:7635:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:beb86ab1-4563-44b1-afd1-f08a43b0622e+5:8511:x1876474454901632:12345-0@lo:104: Request processed in 90us (2714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545612.111592:0:7635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789545612.111610:0:7635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789545612.111616:0:7635:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4cba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:beb86ab1-4563-44b1-afd1-f08a43b0622e+4:8511:x1876474454901760:12345-0@lo:104: 00010000:00010000:3.0:1789545612.111636:0:7635:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994bc0031a00/0x64919c0f856c0432 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c0439 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545612.111674:0:7635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789545612.111680:0:7635:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4cba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:beb86ab1-4563-44b1-afd1-f08a43b0622e+4:8511:x1876474454901760:12345-0@lo:104: Request processed in 64us (2726us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545612.111685:0:7635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789545612.111717:0:7635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789545612.111724:0:7635:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:beb86ab1-4563-44b1-afd1-f08a43b0622e+3:8511:x1876474454901888:12345-0@lo:104: 00010000:00010000:3.0:1789545612.111731:0:7635:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994bee11a600/0x64919c0f856c03d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c03d7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545612.111765:0:7635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789545612.111770:0:7635:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:beb86ab1-4563-44b1-afd1-f08a43b0622e+3:8511:x1876474454901888:12345-0@lo:104: Request processed in 49us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545612.111776:0:7635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1789545612.111793:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789545612.111799:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bc49d1800/0x64919c0f856c04fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c0504 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545612.113064:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1800 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:3.0:1789545612.113070:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bc49d1800/0x64919c0f856c04fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c0504 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545612.113081:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bc49d1800/0x64919c0f856c04fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c0504 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789545612.113090:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bc49d1800/0x64919c0f856c04fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c0504 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545612.113094:0:8511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c8fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1876474454901632:0@lo:104: 10000000:01000000:3.0:1789545612.113107:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1789545612.113109:0:8511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c8c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1876474454901760:0@lo:104: 00000100:00100000:0.0:1789545612.113120:0:8511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c8df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1876474454901888:0@lo:104: 00010000:00010000:3.0:1789545612.113204:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bc49d1800/0x64919c0f856c04fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0504 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545612.113212:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789545612.113246:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bc49d1800/0x64919c0f856c04fd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0504 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545612.113253:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bc49d1800/0x64919c0f856c04fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0504 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545612.113273:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789545612.113277:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bc0031a00/0x64919c0f856c0432 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c0439 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545612.113283:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc0031a00 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:3.0:1789545612.113285:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bc0031a00/0x64919c0f856c0432 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c0439 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545612.113293:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bc0031a00/0x64919c0f856c0432 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c0439 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789545612.113299:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bc0031a00/0x64919c0f856c0432 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c0439 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789545612.113303:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1789545612.113348:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beb86ab1-4563-44b1-afd1-f08a43b0622e:3314:1876474454902016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789545612.113427:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789545612.114451:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789545612.114462:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bee11a600/0x64919c0f856c03d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c03d7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545612.114473:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bee11a600 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:0.0:1789545612.114476:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bee11a600/0x64919c0f856c03d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c03d7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545612.114485:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bee11a600/0x64919c0f856c03d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c03d7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789545612.114491:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bee11a600/0x64919c0f856c03d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c03d7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789545612.114497:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1789545612.114722:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454902016 00000100:00100000:2.0:1789545612.114731:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454902016 00010000:00010000:2.0:1789545612.114927:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bee11ba00/0x64919c0f856c0504 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c04fd expref: 19 pid: 5840 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545612.114973:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789545612.114983:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3314:x1876474454902016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789545612.114997:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545612.115003:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bee11ba00/0x64919c0f856c0504 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c04fd expref: 19 pid: 5840 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545612.115026:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bee11ba00/0x64919c0f856c0504 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c04fd expref: 19 pid: 5840 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545612.115046:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bee11ba00/0x64919c0f856c0504 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c04fd expref: 19 pid: 5840 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545612.115067:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789545612.115136:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:3314:x1876474454902016:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (1708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545612.115144:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789545612.115206:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beb86ab1-4563-44b1-afd1-f08a43b0622e:3314:1876474454902016:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789545612.116466:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545612.120088:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bc0031a00/0x64919c0f856c0432 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0439 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545612.120104:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789545612.120147:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bc0031a00/0x64919c0f856c0432 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0439 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545612.120168:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bc0031a00/0x64919c0f856c0432 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0439 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545612.120187:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545612.120189:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545612.120192:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789545612.120222:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454902144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789545612.120300:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545612.120386:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454902144 00000100:00100000:3.0:1789545612.120394:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454902144 00010000:00010000:3.0:1789545612.120434:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994c0217fa00/0x64919c0f856c0439 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c0432 expref: 18 pid: 5840 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545612.120465:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789545612.120474:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:3311:x1876474454902144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789545612.120487:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545612.120491:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994c0217fa00/0x64919c0f856c0439 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c0432 expref: 18 pid: 5840 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545612.120502:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994c0217fa00/0x64919c0f856c0439 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c0432 expref: 18 pid: 5840 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545612.120516:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994c0217fa00/0x64919c0f856c0439 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c0432 expref: 18 pid: 5840 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545612.120530:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545612.120565:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:3311:x1876474454902144:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545612.120578:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789545612.120623:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454902144:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789545612.121600:0:8453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bee11a600/0x64919c0f856c03d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c03d7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545612.121610:0:8453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789545612.121626:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bee11a600/0x64919c0f856c03d0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c03d7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545612.121641:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bee11a600/0x64919c0f856c03d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c03d7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545612.121657:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545612.121659:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545612.121661:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545612.121698:0:8511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c8ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1876474454901504:192.168.201.16@tcp:104: 00010000:00010000:1.0:1789545612.121730:0:8511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff994bc0031800/0x64919c0f856c0662 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545612.122038:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454902272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789545612.122079:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545612.123169:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454902272 00000100:00100000:0.0:1789545612.123180:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454902272 00010000:00010000:0.0:1789545612.123218:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994c0217ee00/0x64919c0f856c03d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c03d0 expref: 17 pid: 5838 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545612.123253:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789545612.123260:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:3312:x1876474454902272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789545612.123285:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789545612.123290:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994c0217ee00/0x64919c0f856c03d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c03d0 expref: 17 pid: 5838 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545612.123299:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994c0217ee00/0x64919c0f856c03d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c03d0 expref: 17 pid: 5838 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545612.123315:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994c0217ee00/0x64919c0f856c03d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c03d0 expref: 17 pid: 5838 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545612.123330:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789545612.123402:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:3312:x1876474454902272:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545612.123420:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789545612.125264:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454902272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789545612.126967:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545612.127146:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438096512 00000100:00100000:3.0:1789545612.127155:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438096512 00010000:00010000:3.0:1789545612.127191:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bc49d1600/0x64919c0f856c05c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de531c expref: 10 pid: 5839 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545612.127230:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 24 00000100:00100000:3.0:1789545612.127240:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7941446-3286-4db8-8c2a-05ec7eed2433+10:2359:x1876474438096512:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789545612.127253:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545612.127259:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bc49d1600/0x64919c0f856c05c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de531c expref: 10 pid: 5839 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545612.127377:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bc49d1600/0x64919c0f856c05c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de531c expref: 10 pid: 5839 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545612.127397:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc49d1600/0x64919c0f856c05c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de531c expref: 10 pid: 5839 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545612.127423:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff994bc0031800/0x64919c0f856c0662 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545612.127432:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc0031800/0x64919c0f856c0662 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545612.127449:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994bc0031800/0x64919c0f856c0662 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545612.127469:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994bc0031800/0x64919c0f856c0662 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545612.127475:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff994bc0031800/0x64919c0f856c0662 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545612.127482:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff994bc0031800/0x64919c0f856c0662 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545612.127488:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc0031800 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545612.127492:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff994bc0031800/0x64919c0f856c0662 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545612.127500:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff994bc0031800/0x64919c0f856c0662 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545612.127519:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff994bc0031800/0x64919c0f856c0662 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545612.127529:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545612.127624:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7941446-3286-4db8-8c2a-05ec7eed2433+9:2359:x1876474438096512:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 385us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545612.127633:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 24 00010000:00010000:1.0:1789545612.129700:0:8511:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff994bc0031800/0x64919c0f856c0662 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545612.129718:0:8511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff994bc0031800/0x64919c0f856c0662 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545612.129726:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc0031800/0x64919c0f856c0662 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545612.214842:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545612.214886:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545612.214911:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545612.214936:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438096896 00000100:00100000:3.0:1789545612.214945:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438096896 00000100:00100000:3.0:1789545612.215011:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438096768 00000100:00100000:3.0:1789545612.215020:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438096768 00000100:00100000:3.0:1789545612.215045:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 16 00000100:00100000:3.0:1789545612.215055:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+5:2359:x1876474438096896:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:3.0:1789545612.215118:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+5:2359:x1876474438096896:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 66us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545612.215124:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 16 00000100:00100000:3.0:1789545612.215140:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 17 00000100:00100000:3.0:1789545612.215145:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+5:2359:x1876474438096768:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:3.0:1789545612.215165:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+5:2359:x1876474438096768:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 20us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545612.215170:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 17 00000100:00080000:3.0:1789545612.215189:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789545612.215193:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789545612.215496:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438096640 00000100:00100000:2.0:1789545612.215501:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438096640 00000100:00100000:2.0:1789545612.215538:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 31 00000100:00100000:2.0:1789545612.215544:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+6:2359:x1876474438096640:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545612.215594:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+6:2359:x1876474438096640:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 50us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545612.215601:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 31 00000100:00080000:3.0:1789545612.215770:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789545613.118982:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789545613.300673:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545613.300709:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438097024 00000100:00100000:3.0:1789545613.300719:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438097024 00000100:00100000:3.0:1789545613.300837:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 172 00000100:00100000:3.0:1789545613.300848:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+9:5596:x1876474438097024:12345-192.168.201.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789545613.300864:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545613.300884:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994c0217e200/0x64919c0f856c0669 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de535b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545613.300913:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994c0217e200/0x64919c0f856c0669 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de535b expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545613.300925:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994c0217e200/0x64919c0f856c0669 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de535b expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545613.300944:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217e200, rc 0) 00000100:00100000:3.0:1789545613.300998:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+10:5596:x1876474438097024:12345-192.168.201.16@tcp:101:ll_cfg_requeue.0 Request processed in 152us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545613.301005:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 172 00000100:00100000:3.0:1789545613.306353:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545613.306420:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438097152 00000100:00100000:3.0:1789545613.306431:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438097152 00000100:00100000:3.0:1789545613.306484:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 173 00000100:00100000:3.0:1789545613.306495:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+10:5596:x1876474438097152:12345-192.168.201.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789545613.309012:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+10:5596:x1876474438097152:12345-192.168.201.16@tcp:501:ll_cfg_requeue.0 Request processed in 2508us (2672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545613.309026:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 173 00000100:00100000:3.0:1789545613.314936:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545613.315319:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438097280 00000100:00100000:3.0:1789545613.315330:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438097280 00000100:00100000:3.0:1789545613.315483:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 174 00000100:00100000:3.0:1789545613.315494:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+10:5596:x1876474438097280:12345-192.168.201.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789545613.316511:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+10:5596:x1876474438097280:12345-192.168.201.16@tcp:503:ll_cfg_requeue.0 Request processed in 1013us (1579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545613.316525:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 174 00000100:00100000:0.0:1789545613.326577:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545613.331250:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438097408 00000100:00100000:3.0:1789545613.331263:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438097408 00000100:00100000:3.0:1789545613.331328:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 175 00000100:00100000:3.0:1789545613.331339:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+10:6151:x1876474438097408:12345-192.168.201.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789545613.331949:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+10:6151:x1876474438097408:12345-192.168.201.16@tcp:502:llog_process_th.0 Request processed in 610us (5381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545613.331958:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 175 00000100:00100000:3.0:1789545613.335892:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545613.336126:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438097536 00000100:00100000:0.0:1789545613.336137:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438097536 00000100:00100000:0.0:1789545613.336265:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 176 00000100:00100000:0.0:1789545613.336277:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+10:6151:x1876474438097536:12345-192.168.201.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789545613.336577:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+10:6151:x1876474438097536:12345-192.168.201.16@tcp:502:llog_process_th.0 Request processed in 302us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545613.336586:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 176 10000000:01000000:3.0:1789545613.630860:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789545613.630869:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994bdfb06800 from 4 10000000:01000000:3.0:1789545613.630875:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789545613.630922:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994c0217fa00/0x64919c0f856c0670 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545613.630935:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994c0217fa00/0x64919c0f856c0670 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545613.630946:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994c0217fa00/0x64919c0f856c0670 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545613.630986:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454902400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789545613.631054:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545613.631111:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bedbee0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789545613.631231:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454902400 00000100:00100000:2.0:1789545613.631240:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454902400 00000100:00100000:2.0:1789545613.631294:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789545613.631304:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:5843:x1876474454902400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789545613.631317:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545613.631516:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc49d1c00/0x64919c0f856c0677 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c0670 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545613.631544:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc49d1c00/0x64919c0f856c0677 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c0670 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545613.631556:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc49d1c00/0x64919c0f856c0677 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0670 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545613.631566:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1c00, rc 0) 00000100:00100000:2.0:1789545613.631624:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:5843:x1876474454902400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 320us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545613.631633:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789545613.631658:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454902400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789545613.631676:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994c0217fa00/0x64919c0f856c0670 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0677 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545613.631686:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994c0217fa00/0x64919c0f856c0670 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c0677 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545613.631740:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454902528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789545613.631767:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545613.631819:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bedbee0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789545613.633164:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454902528 00000100:00100000:0.0:1789545613.633176:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454902528 00000100:00100000:0.0:1789545613.633230:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789545613.633239:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:5843:x1876474454902528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789545613.634022:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:5843:x1876474454902528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 782us (2252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545613.634031:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789545613.634071:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454902528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789545613.634122:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454902656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789545613.634167:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545613.634219:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454902656 00000100:00100000:3.0:1789545613.634220:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bedbee0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789545613.634226:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454902656 00000100:00100000:2.0:1789545613.634261:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789545613.634267:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:5843:x1876474454902656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789545613.634564:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:5843:x1876474454902656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 296us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545613.634578:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789545613.634917:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454902656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789545613.636044:0:8556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994becd93800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8556:1876474454902784:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789545613.636103:0:8556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545613.636140:0:8556:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bfbcb8780 going to sleep for 11 seconds 00000100:00100000:0.0:1789545613.636333:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454902784 00000100:00100000:0.0:1789545613.636350:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454902784 00000100:00100000:0.0:1789545613.636429:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789545613.636439:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:8556:x1876474454902784:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789545613.636624:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:8556:x1876474454902784:12345-0@lo:502:llog_process_th.0 Request processed in 186us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545613.636632:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789545613.636822:0:8556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994becd93800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8556:1876474454902784:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789545613.636851:0:8556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789545613.636860:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789545613.636862:0:8556:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789545613.636868:0:8556:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff994bdfb06800 00000020:00000080:1.0:1789545613.636870:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789545613.636944:0:8556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994becd93800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8556:1876474454902912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789545613.636976:0:8556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545613.636997:0:8556:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8e740c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789545613.639535:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454902912 00000100:00100000:2.0:1789545613.639551:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454902912 00000100:00100000:2.0:1789545613.639602:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789545613.639612:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:8556:x1876474454902912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789545613.639854:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:8556:x1876474454902912:12345-0@lo:502:llog_process_th.0 Request processed in 243us (2876us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545613.639862:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789545613.642620:0:8556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994becd93800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8556:1876474454902912:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789545613.642665:0:8556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789545613.642674:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545613.642676:0:8556:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789545613.642680:0:8556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789545613.642831:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789545613.642850:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789545613.642861:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994c0217fa00/0x64919c0f856c0670 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0677 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545613.642872:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994c0217fa00/0x64919c0f856c0670 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0677 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789545613.642889:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789545613.642891:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994bc8231800 from 4 10000000:01000000:0.0:1789545613.642894:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789545613.642928:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0031000/0x64919c0f856c067e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545613.642936:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc0031000/0x64919c0f856c067e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545613.642945:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc0031000/0x64919c0f856c067e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545613.642967:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c8e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454903040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789545613.643023:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545613.643077:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd1bf9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789545613.644501:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454903040 00000100:00100000:2.0:1789545613.644512:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454903040 00000100:00100000:2.0:1789545613.644555:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789545613.644564:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:5843:x1876474454903040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789545613.644579:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545613.644596:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc49d1200/0x64919c0f856c0685 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c067e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545613.644619:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc49d1200/0x64919c0f856c0685 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c067e expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545613.644630:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc49d1200/0x64919c0f856c0685 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c067e expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545613.644651:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1200, rc 0) 00000100:00100000:2.0:1789545613.644715:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:5843:x1876474454903040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (1691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545613.644722:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789545613.644769:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c8e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454903040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789545613.644784:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc0031000/0x64919c0f856c067e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0685 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545613.644793:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc0031000/0x64919c0f856c067e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c0685 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545613.644851:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454903168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789545613.644879:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545613.644903:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfae0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789545613.644914:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454903168 00000100:00100000:2.0:1789545613.644918:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454903168 00000100:00100000:2.0:1789545613.644937:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789545613.644943:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:5843:x1876474454903168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789545613.645149:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:5843:x1876474454903168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 205us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545613.645154:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789545613.645179:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454903168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789545613.645204:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454903296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789545613.645236:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545613.645255:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfae0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789545613.645265:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454903296 00000100:00100000:2.0:1789545613.645268:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454903296 00000100:00100000:2.0:1789545613.645286:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789545613.645292:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:5843:x1876474454903296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789545613.645458:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:5843:x1876474454903296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545613.645463:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789545613.645496:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454903296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789545613.645660:0:8558:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8558:1876474454903424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789545613.645690:0:8558:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545613.645706:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454903424 00000100:00100000:2.0:1789545613.645710:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454903424 00000100:00100000:2.0:1789545613.645729:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789545613.645734:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:8558:x1876474454903424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789545613.645838:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:8558:x1876474454903424:12345-0@lo:502:llog_process_th.0 Request processed in 104us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545613.645844:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789545613.645875:0:8558:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfae0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789545613.645886:0:8558:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8558:1876474454903424:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789545613.645906:0:8558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789545613.645915:0:8558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545613.645917:0:8558:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789545613.645924:0:8558:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff994bc8231800 00000020:00000080:2.0:1789545613.645926:0:8558:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789545613.645996:0:8558:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8558:1876474454903552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789545613.646032:0:8558:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545613.646051:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454903552 00000100:00100000:2.0:1789545613.646054:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454903552 00000100:00100000:2.0:1789545613.646073:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789545613.646079:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:8558:x1876474454903552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789545613.646175:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:8558:x1876474454903552:12345-0@lo:502:llog_process_th.0 Request processed in 95us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545613.646181:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789545613.646214:0:8558:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfae0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789545613.646226:0:8558:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8558:1876474454903552:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789545613.646243:0:8558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789545613.646247:0:8558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545613.646249:0:8558:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789545613.646252:0:8558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789545613.646294:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789545613.646307:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789545613.646314:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0031000/0x64919c0f856c067e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0685 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545613.646325:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc0031000/0x64919c0f856c067e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0685 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789545613.646334:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789545613.646337:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994bc4a49800 from 4 10000000:01000000:2.0:1789545613.646339:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789545613.646377:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d0c00/0x64919c0f856c068c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545613.646397:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc49d0c00/0x64919c0f856c068c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545613.646411:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc49d0c00/0x64919c0f856c068c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545613.646424:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454903680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789545613.646447:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545613.646465:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfae0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789545613.646476:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454903680 00000100:00100000:2.0:1789545613.646479:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454903680 00000100:00100000:2.0:1789545613.646499:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789545613.646505:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:5843:x1876474454903680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789545613.646512:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545613.646522:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc49d1e00/0x64919c0f856c0693 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c068c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545613.646537:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc49d1e00/0x64919c0f856c0693 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c068c expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545613.646546:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc49d1e00/0x64919c0f856c0693 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c068c expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545613.646552:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1e00, rc 0) 00000100:00100000:2.0:1789545613.646581:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:5843:x1876474454903680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 75us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545613.646587:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789545613.646614:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454903680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789545613.646625:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc49d0c00/0x64919c0f856c068c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0693 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545613.646638:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc49d0c00/0x64919c0f856c068c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c0693 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545613.646670:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454903808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789545613.646691:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545613.646703:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfae0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789545613.646713:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454903808 00000100:00100000:2.0:1789545613.646715:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454903808 00000100:00100000:2.0:1789545613.646732:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789545613.646737:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:5843:x1876474454903808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789545613.649323:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:5843:x1876474454903808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2578us (2622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545613.650489:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789545613.650569:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454903808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789545613.650628:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454903936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789545613.650692:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545613.650729:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfae0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789545613.650745:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454903936 00000100:00100000:2.0:1789545613.650752:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454903936 00000100:00100000:2.0:1789545613.650786:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789545613.650795:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:5843:x1876474454903936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789545613.650970:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:5843:x1876474454903936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545613.650978:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789545613.651024:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454903936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789545613.658499:0:8560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb41f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8560:1876474454904064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789545613.658651:0:8560:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545613.659906:0:8560:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bedbeecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789545613.665643:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454904064 00000100:00100000:0.0:1789545613.665660:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454904064 00000100:00100000:0.0:1789545613.665730:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789545613.665741:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:8560:x1876474454904064:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789545613.666149:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:8560:x1876474454904064:12345-0@lo:502:llog_process_th.0 Request processed in 408us (7496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545613.666157:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789545613.666470:0:8560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb41f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8560:1876474454904064:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789545613.666504:0:8560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789545613.666514:0:8560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789545613.666516:0:8560:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789545613.667257:0:8560:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff994bc4a49800 00000020:00000080:3.0:1789545613.667261:0:8560:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789545613.667393:0:8560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb41f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8560:1876474454904192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789545613.667462:0:8560:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545613.667511:0:8560:0:(client.c:2716:ptlrpc_set_wait()) set ffff994ac2b53000 going to sleep for 11 seconds 00000100:00100000:1.0:1789545613.668781:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454904192 00000100:00100000:1.0:1789545613.668793:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454904192 00000100:00100000:1.0:1789545613.668840:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789545613.668849:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bf56acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:8560:x1876474454904192:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789545613.669104:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bf56acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:8560:x1876474454904192:12345-0@lo:502:llog_process_th.0 Request processed in 254us (1640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545613.669112:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789545613.669404:0:8560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb41f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:8560:1876474454904192:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789545613.669435:0:8560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789545613.669886:0:8560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789545613.669890:0:8560:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789545613.669897:0:8560:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789545613.671125:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789545613.671150:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789545613.671160:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d0c00/0x64919c0f856c068c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0693 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545613.671174:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc49d0c00/0x64919c0f856c068c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0693 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545614.144081:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545615.166139:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789545615.932656:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beb86ab1-4563-44b1-afd1-f08a43b0622e:3313:1876474454904320:0@lo:400:kworker.0 00000100:00100000:3.0:1789545615.932728:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545615.932796:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876474454904832:0@lo:400:kworker.0 00000100:00100000:3.0:1789545615.932823:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545615.932850:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789545615.932856:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454904448:0@lo:400:kworker.0 00000100:00100000:3.0:1789545615.932878:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545615.932894:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454904960:0@lo:400:kworker.0 00000100:00100000:3.0:1789545615.932912:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545615.932937:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876474454904576:0@lo:400:kworker.0 00000100:00100000:3.0:1789545615.932957:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545615.932974:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789545615.932980:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454904704:0@lo:400:kworker.0 00000100:00100000:3.0:1789545615.933014:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545615.933055:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454904832 00000100:00100000:3.0:1789545615.933062:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454904832 00000100:00100000:3.0:1789545615.933107:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454904448 00000100:00100000:3.0:1789545615.933110:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454904448 00000100:00100000:3.0:1789545615.933124:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454904576 00000100:00100000:3.0:1789545615.933126:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454904576 00000100:00100000:0.0:1789545615.933140:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454904320 00000100:00100000:3.0:1789545615.933142:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789545615.933143:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454904320 00000100:00100000:3.0:1789545615.933149:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876474454904832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545615.933173:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789545615.933179:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3313:x1876474454904320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545615.933200:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876474454904832:12345-0@lo:400:kworker.0 Request processed in 52us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545615.933207:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789545615.933224:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789545615.933230:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454904448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545615.933257:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454904448:12345-0@lo:400:kworker.0 Request processed in 27us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545615.933272:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789545615.933284:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789545615.933290:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876474454904576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545615.933323:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876474454904576:12345-0@lo:400:kworker.0 Request processed in 33us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545615.933329:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789545615.933385:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454904960 00000100:00100000:3.0:1789545615.933390:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454904960 00000100:00100000:3.0:1789545615.933415:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454904704 00000100:00100000:3.0:1789545615.933418:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454904704 00000100:00100000:3.0:1789545615.933435:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789545615.933439:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3313:x1876474454904320:12345-0@lo:400:kworker.0 Request processed in 260us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545615.933441:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454904960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545615.933446:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789545615.933471:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454904960:12345-0@lo:400:kworker.0 Request processed in 30us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545615.933476:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789545615.933486:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789545615.933491:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf6c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454904704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545615.933517:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf6c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454904704:12345-0@lo:400:kworker.0 Request processed in 26us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545615.933522:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1789545615.933544:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789545615.933547:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789545615.933550:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789545615.933581:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bdfb43800 x1876474454904704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545615.933595:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454904704:0@lo:400:kworker.0 00000100:00100000:3.0:1789545615.933614:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876474454904576:0@lo:400:kworker.0 00000100:00100000:3.0:1789545615.933637:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454904448:0@lo:400:kworker.0 00010000:00080000:3.0:1789545615.933646:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bdfb41880 x1876474454904960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545615.933654:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454904960:0@lo:400:kworker.0 00000100:00100000:3.0:1789545615.933662:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beb86ab1-4563-44b1-afd1-f08a43b0622e:3313:1876474454904320:0@lo:400:kworker.0 00000100:00100000:3.0:1789545615.933669:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876474454904832:0@lo:400:kworker.0 00010000:00010000:3.0:1789545616.188470:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545616.444693:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789545616.448551:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454905216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789545616.448620:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545616.448682:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf6c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454905088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789545616.448700:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545616.448758:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454905216 00000100:00100000:2.0:1789545616.448764:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454905216 00000100:00100000:2.0:1789545616.448798:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454905088 00000100:00100000:2.0:1789545616.448800:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454905088 00000100:00100000:2.0:1789545616.448813:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789545616.448821:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454905216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789545616.448854:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789545616.448894:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454905216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545616.448900:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789545616.448914:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789545616.448919:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454905088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789545616.448948:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789545616.448972:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454905088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545616.448977:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1789545616.449382:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bc9c8f800 x1876474454905216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545632 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545616.449402:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454905216:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789545616.449414:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bdf6c3100 x1876474454905088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545632 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545616.449433:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf6c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454905088:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789545617.214356:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545617.331919:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545617.331966:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545617.331995:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545617.332023:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545617.332056:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438097920 00000100:00100000:2.0:1789545617.332067:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438097920 00000100:00100000:2.0:1789545617.332139:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438098048 00000100:00100000:2.0:1789545617.332143:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438098048 00000100:00100000:2.0:1789545617.332166:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 20 00000100:00100000:2.0:1789545617.332175:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+5:2358:x1876474438097920:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545617.332234:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+5:2358:x1876474438097920:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 61us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545617.332242:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 20 00000100:00100000:2.0:1789545617.332257:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 21 00000100:00100000:2.0:1789545617.332262:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+5:2358:x1876474438098048:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545617.332280:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+5:2358:x1876474438098048:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 18us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545617.332285:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 21 00000100:00100000:2.0:1789545617.332300:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438097792 00000100:00100000:2.0:1789545617.332303:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438097792 00000100:00100000:2.0:1789545617.332341:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 35 00000100:00100000:2.0:1789545617.332347:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+6:2358:x1876474438097792:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545617.332405:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+6:2358:x1876474438097792:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 58us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545617.332418:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 35 00000100:00080000:2.0:1789545617.332436:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789545617.332440:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789545617.332442:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789545617.332759:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438097664 00000100:00100000:1.0:1789545617.332765:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438097664 00000100:00100000:1.0:1789545617.332794:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 193 00000100:00100000:1.0:1789545617.332801:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+10:2358:x1876474438097664:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545617.332834:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+10:2358:x1876474438097664:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 34us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545617.332841:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 193 00010000:00010000:0.0:1789545618.239342:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789545619.216264:0:8810:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg116-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1789545619.261494:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545620.284739:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545621.062285:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789545621.062309:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994becd93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beb86ab1-4563-44b1-afd1-f08a43b0622e:3314:1876474454905344:0@lo:400:kworker.0 00000100:00100000:1.0:1789545621.062393:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545621.062457:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454905344 00000100:00100000:1.0:1789545621.062465:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454905344 00000100:00100000:1.0:1789545621.062506:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1789545621.062516:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3314:x1876474454905344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545621.062568:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3314:x1876474454905344:12345-0@lo:400:kworker.0 Request processed in 52us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545621.062586:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1789545621.062635:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994becd93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beb86ab1-4563-44b1-afd1-f08a43b0622e:3314:1876474454905344:0@lo:400:kworker.0 00000100:00100000:1.0:1789545621.062674:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994becd93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876474454905472:0@lo:400:kworker.0 00000100:00100000:1.0:1789545621.062700:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545621.062727:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454905472 00000100:00100000:1.0:1789545621.062731:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454905472 00000100:00100000:0.0:1789545621.063064:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876474454905600:0@lo:400:kworker.0 00000100:00100000:0.0:1789545621.063093:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545621.063129:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454905600 00000100:00100000:0.0:1789545621.063133:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454905600 00000100:00100000:0.0:1789545621.063172:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789545621.063180:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876474454905600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545621.063220:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876474454905600:12345-0@lo:400:kworker.0 Request processed in 42us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545621.063226:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1789545621.063242:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789545621.063277:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876474454905600:0@lo:400:kworker.0 00000100:00100000:0.0:1789545621.063307:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454905728:0@lo:400:kworker.0 00000100:00100000:0.0:1789545621.063332:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545621.063380:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454905728 00000100:00100000:0.0:1789545621.063385:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454905728 00000100:00100000:0.0:1789545621.063418:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789545621.063424:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454905728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545621.063460:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454905728:12345-0@lo:400:kworker.0 Request processed in 35us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545621.063478:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1789545621.063498:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789545621.063518:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bc9c8f480 x1876474454905728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545621.063528:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454905728:0@lo:400:kworker.0 00000100:00100000:0.0:1789545621.063561:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789545621.063566:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876474454905856:0@lo:400:kworker.0 00000100:00100000:0.0:1789545621.063588:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545621.063610:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454905856 00000100:00100000:0.0:1789545621.063613:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454905856 00000100:00100000:0.0:1789545621.063639:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789545621.063646:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876474454905856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545621.063678:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876474454905856:12345-0@lo:400:kworker.0 Request processed in 32us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545621.063684:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1789545621.063699:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789545621.063714:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876474454905856:0@lo:400:kworker.0 00000100:00100000:1.0:1789545621.064123:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789545621.064132:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876474454905472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545621.064167:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876474454905472:12345-0@lo:400:kworker.0 Request processed in 37us (1466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545621.064173:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789545621.064232:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454905984:0@lo:400:kworker.0 00000100:00100000:0.0:1789545621.064272:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545621.065241:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994becd93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876474454905472:0@lo:400:kworker.0 00000100:00100000:2.0:1789545621.066436:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454905984 00000100:00100000:2.0:1789545621.066447:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454905984 00000100:00100000:2.0:1789545621.066501:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789545621.066511:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454905984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545621.066593:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454905984:12345-0@lo:400:kworker.0 Request processed in 83us (2320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545621.066600:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1789545621.066963:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789545621.068054:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bc9c8f480 x1876474454905984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545621.068068:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454905984:0@lo:400:kworker.0 00010000:00010000:2.0:1789545621.320493:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545621.564527:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789545621.564551:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994becd90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454906240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789545621.564619:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545621.564676:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf6c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454906112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789545621.564699:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545621.564731:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454906240 00000100:00100000:1.0:1789545621.564738:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454906240 00000100:00100000:1.0:1789545621.564772:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454906112 00000100:00100000:1.0:1789545621.564775:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454906112 00000100:00100000:1.0:1789545621.564806:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789545621.564815:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454906240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789545621.564972:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789545621.565070:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454906240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 255us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545621.565087:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789545621.565105:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789545621.565111:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454906112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789545621.565131:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789545621.565160:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454906112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545621.565166:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1789545621.568656:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994becd90000 x1876474454906240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545637 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545621.568682:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994becd90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454906240:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789545621.568697:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bdf6c1c00 x1876474454906112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545637 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545621.568709:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf6c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454906112:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789545622.332604:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545622.469982:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545622.470021:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545622.470059:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545622.470094:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545622.470119:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438098176 00000100:00100000:2.0:1789545622.470128:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438098176 00000100:00100000:2.0:1789545622.470170:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 195 00000100:00100000:2.0:1789545622.470179:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+10:2360:x1876474438098176:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545622.470250:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+10:2360:x1876474438098176:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 71us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545622.470257:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 195 00000100:00100000:0.0:1789545622.470456:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438098432 00000100:00100000:0.0:1789545622.470460:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438098432 00000100:00100000:0.0:1789545622.470508:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438098560 00000100:00100000:0.0:1789545622.470511:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438098560 00000100:00100000:0.0:1789545622.470531:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10 00000100:00100000:0.0:1789545622.470544:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+5:2357:x1876474438098432:12345-192.168.201.16@tcp:9:kworker.0 00000020:00000080:0.0:1789545622.470581:0:6693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c05cf 00000100:00080000:0.0:1789545622.470600:0:6693:0:(import.c:65:import_set_state_nolock()) ffff994be4c98800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789545622.470638:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789545622.470981:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+2:2357:x1876474438098432:12345-192.168.201.16@tcp:9:kworker.0 Request processed in 438us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545622.470989:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10 00000100:00100000:0.0:1789545622.471004:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11 00000100:00100000:0.0:1789545622.471011:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+5:2357:x1876474438098560:12345-192.168.201.16@tcp:9:kworker.0 00000020:00000080:0.0:1789545622.471024:0:6693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c05d6 00000100:00080000:0.0:1789545622.471030:0:6693:0:(import.c:65:import_set_state_nolock()) ffff994be4c9d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789545622.471050:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789545622.471205:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+2:2357:x1876474438098560:12345-192.168.201.16@tcp:9:kworker.0 Request processed in 194us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545622.471212:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11 00000100:00100000:0.0:1789545622.471245:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438098304 00000100:00100000:0.0:1789545622.471249:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438098304 00000100:00100000:0.0:1789545622.471276:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 39 00000100:00100000:0.0:1789545622.471282:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc641d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+6:2360:x1876474438098304:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:0.0:1789545622.471305:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc641d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+6:2360:x1876474438098304:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 24us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545622.471311:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 39 00010000:00010000:0.0:1789545622.471411:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545622.471475:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789545622.472195:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789545622.472200:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789545622.472202:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789545623.356901:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789545623.786891:0:9054:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg116-server.virtnet: executing yml_node 00010000:00010000:3.0:1789545624.380556:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545625.404576:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789545625.791109:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8a8edb7a-f384-4468-93f4-9d664f284862 00000020:00000080:3.0:1789545625.791119:0:6717:0:(genops.c:885:class_export_put()) final put ffff994be4c9e000/8a8edb7a-f384-4468-93f4-9d664f284862 00000020:00000080:0.0:1789545625.791854:0:1469:0:(genops.c:844:class_export_destroy()) destroying export ffff994be4c9e000/8a8edb7a-f384-4468-93f4-9d664f284862 for lustre-OST0000 00000020:00000080:0.0:1789545625.791917:0:1469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff994be4c98800 for lustre-OST0000 00000100:00100000:1.0:1789545626.173036:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994becd93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454906368:0@lo:400:kworker.0 00000100:00100000:1.0:1789545626.173113:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545626.173174:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994becd90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454906880:0@lo:400:kworker.0 00000100:00100000:1.0:1789545626.173229:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545626.173255:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789545626.173261:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994becd91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454906752:0@lo:400:kworker.0 00000100:00100000:1.0:1789545626.173287:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545626.173315:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994becd92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876474454906624:0@lo:400:kworker.0 00000100:00100000:1.0:1789545626.173338:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545626.173354:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789545626.173382:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994becd92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876474454906496:0@lo:400:kworker.0 00000100:00100000:1.0:1789545626.173404:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545626.173419:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994becd93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454907008:0@lo:400:kworker.0 00000100:00100000:1.0:1789545626.173440:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545626.173467:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454906368 00000100:00100000:1.0:1789545626.173475:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454906368 00000100:00100000:1.0:1789545626.173517:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789545626.173540:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3312:x1876474454906368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545626.173593:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3312:x1876474454906368:12345-0@lo:400:kworker.0 Request processed in 53us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545626.173600:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789545626.173644:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994becd93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454906368:0@lo:400:kworker.0 00000100:00100000:0.0:1789545626.174002:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454906880 00000100:00100000:0.0:1789545626.174007:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454906880 00000100:00100000:0.0:1789545626.174047:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454906624 00000100:00100000:0.0:1789545626.174050:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454906624 00000100:00100000:0.0:1789545626.174063:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454906496 00000100:00100000:0.0:1789545626.174066:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454906496 00000100:00100000:0.0:1789545626.174078:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789545626.174085:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454906880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545626.174138:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454906880:12345-0@lo:400:kworker.0 Request processed in 53us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545626.174144:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789545626.174168:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789545626.174176:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876474454906624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545626.174222:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876474454906624:12345-0@lo:400:kworker.0 Request processed in 47us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545626.174227:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789545626.174239:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789545626.174247:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876474454906496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545626.174274:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876474454906496:12345-0@lo:400:kworker.0 Request processed in 28us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545626.174279:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789545626.174298:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454906752 00000100:00100000:0.0:1789545626.174302:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454906752 00000100:00100000:0.0:1789545626.174327:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454907008 00000100:00100000:0.0:1789545626.174330:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454907008 00000100:00100000:0.0:1789545626.174350:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789545626.174356:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454906752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545626.174419:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454906752:12345-0@lo:400:kworker.0 Request processed in 62us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545626.174425:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789545626.174438:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789545626.174445:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454907008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545626.174470:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454907008:12345-0@lo:400:kworker.0 Request processed in 27us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545626.174475:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789545626.174524:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994becd92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876474454906496:0@lo:400:kworker.0 00010000:00080000:0.0:1789545626.174537:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994becd93100 x1876474454907008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545626.174547:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994becd93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454907008:0@lo:400:kworker.0 00000100:00100000:0.0:1789545626.174556:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994becd92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876474454906624:0@lo:400:kworker.0 00010000:00080000:3.0:1789545626.174701:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994becd91f80 x1876474454906752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545626.174712:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994becd91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454906752:0@lo:400:kworker.0 00000100:00100000:3.0:1789545626.174723:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994becd90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454906880:0@lo:400:kworker.0 00000100:00080000:1.0:1789545626.176181:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789545626.176201:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789545626.176205:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1789545626.290672:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8a8edb7a-f384-4468-93f4-9d664f284862 00000020:00000080:0.0:1789545626.290682:0:7650:0:(genops.c:885:class_export_put()) final put ffff994be4c9a000/8a8edb7a-f384-4468-93f4-9d664f284862 00000020:00000080:1.0:1789545626.291102:0:1469:0:(genops.c:844:class_export_destroy()) destroying export ffff994be4c9a000/8a8edb7a-f384-4468-93f4-9d664f284862 for lustre-OST0001 00000020:00000080:1.0:1789545626.291178:0:1469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff994be4c9d800 for lustre-OST0001 00010000:00010000:3.0:1789545626.431660:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545626.684651:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf6c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454907136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789545626.684718:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545626.684889:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454907136 00000100:00100000:2.0:1789545626.684898:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454907136 00000100:00100000:1.0:1789545626.684911:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994becd93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454907264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789545626.684940:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545626.689008:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454907264 00000100:00100000:2.0:1789545626.689024:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454907264 00000100:00100000:2.0:1789545626.689081:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789545626.689092:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454907136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789545626.689132:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789545626.689232:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454907136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (4513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545626.689239:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789545626.689256:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789545626.689262:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454907264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789545626.689279:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789545626.689314:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454907264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (4374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545626.689320:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1789545626.689414:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994becd93800 x1876474454907264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545642 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545626.689435:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994becd93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454907264:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789545626.690245:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bdf6c0700 x1876474454907136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545642 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545626.690265:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf6c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454907136:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789545627.452553:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545627.572684:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545627.572752:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545627.572794:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438098816 00000100:00100000:0.0:1789545627.572826:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438098816 00000100:00100000:0.0:1789545627.572909:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 43 00000100:00100000:0.0:1789545627.572923:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+6:2360:x1876474438098816:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:0.0:1789545627.573036:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+6:2360:x1876474438098816:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 116us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545627.573043:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 43 00000100:00080000:0.0:1789545627.573074:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789545627.573977:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438098688 00000100:00100000:3.0:1789545627.573990:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438098688 00000100:00100000:3.0:1789545627.574051:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 197 00000100:00100000:3.0:1789545627.574061:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+10:2360:x1876474438098688:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:3.0:1789545627.574148:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+10:2360:x1876474438098688:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 88us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545627.574155:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 197 00000001:02000400:2.0:1789545628.347712:0:9251:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00010000:00010000:0.0:1789545628.477586:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545629.500624:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545630.531555:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789545630.764992:0:9348:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00000100:00100000:3.0:1789545631.293159:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf6c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454907392:0@lo:400:kworker.0 00000100:00100000:3.0:1789545631.293234:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545631.293652:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454907392 00000100:00100000:1.0:1789545631.293662:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454907392 00000100:00100000:1.0:1789545631.293713:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789545631.293723:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3312:x1876474454907392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545631.293779:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3312:x1876474454907392:12345-0@lo:400:kworker.0 Request processed in 58us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545631.293786:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789545631.294027:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994becd91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454907520:0@lo:400:kworker.0 00000100:00100000:1.0:1789545631.294057:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545631.294131:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454907520 00000100:00100000:1.0:1789545631.294136:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454907520 00000100:00100000:1.0:1789545631.294165:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789545631.294172:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454907520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545631.294213:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf6c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454907392:0@lo:400:kworker.0 00000100:00100000:0.0:1789545631.297998:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454908032:0@lo:400:kworker.0 00000100:00100000:3.0:1789545631.298212:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454907904:0@lo:400:kworker.0 00000100:00100000:1.0:1789545631.298451:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454907520:12345-0@lo:400:kworker.0 Request processed in 4277us (4390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545631.298471:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789545631.298539:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454907776:0@lo:400:kworker.0 00000100:00100000:1.0:1789545631.298591:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545631.298725:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454907776 00000100:00100000:1.0:1789545631.298733:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454907776 00000100:00100000:1.0:1789545631.298781:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789545631.298790:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454907776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545631.298954:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454907776:12345-0@lo:400:kworker.0 Request processed in 165us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545631.298962:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1789545631.299438:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789545631.299476:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bc9c8f800 x1876474454907776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545631.299492:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454907776:0@lo:400:kworker.0 00000100:00100000:1.0:1789545631.299536:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876474454907648:0@lo:400:kworker.0 00000100:00100000:1.0:1789545631.299567:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545631.299597:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454907648 00000100:00100000:1.0:1789545631.299602:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454907648 00000100:00100000:1.0:1789545631.299635:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789545631.299642:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876474454907648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545631.299685:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876474454907648:12345-0@lo:400:kworker.0 Request processed in 43us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545631.299692:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1789545631.299706:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789545631.299720:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876474454907648:0@lo:400:kworker.0 00000100:00100000:0.0:1789545631.300405:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545631.300440:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994becd91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454907520:0@lo:400:kworker.0 00000100:00100000:0.0:1789545631.300471:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454908032 00000100:00100000:0.0:1789545631.300476:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454908032 00000100:00100000:0.0:1789545631.300510:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789545631.300516:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454908032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545631.300549:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454908032:12345-0@lo:400:kworker.0 Request processed in 33us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545631.300555:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1789545631.300581:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bc9c8e680 x1876474454908032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545631.300593:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454908032:0@lo:400:kworker.0 00000100:00080000:0.0:1789545631.300624:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789545631.306450:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545631.306587:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454907904 00000100:00100000:1.0:1789545631.306597:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454907904 00000100:00100000:1.0:1789545631.306669:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789545631.306684:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454907904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545631.306744:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454907904:12345-0@lo:400:kworker.0 Request processed in 67us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545631.306751:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789545631.307032:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454907904:0@lo:400:kworker.0 00000100:00080000:0.0:1789545631.308381:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789545631.551965:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545631.805290:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf6c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454908160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789545631.805444:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545631.806107:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454908160 00000100:00100000:2.0:1789545631.806123:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454908160 00000100:00100000:3.0:1789545631.806140:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf6c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454908288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789545631.806185:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789545631.806194:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545631.806206:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454908160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789545631.806247:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789545631.806524:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454908160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 325us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545631.806531:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789545631.806549:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454908288 00000100:00100000:2.0:1789545631.806553:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454908288 00000100:00100000:2.0:1789545631.806570:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789545631.806576:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf6c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454908288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789545631.806595:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789545631.806636:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf6c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454908288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545631.806643:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1789545631.806701:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bdf6c1880 x1876474454908160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545647 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1789545631.806707:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bdf6c3b80 x1876474454908288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545647 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545631.806753:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf6c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454908288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789545631.806987:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf6c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454908160:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789545632.572651:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545632.691002:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545632.691085:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438099072 00000100:00100000:1.0:1789545632.691095:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438099072 00000100:00100000:0.0:1789545632.691118:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545632.691174:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 47 00000100:00100000:1.0:1789545632.691186:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+6:2361:x1876474438099072:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:3.0:1789545632.691351:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438098944 00000100:00100000:3.0:1789545632.691355:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438098944 00000100:00100000:3.0:1789545632.691405:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 199 00000100:00100000:3.0:1789545632.691413:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+10:2361:x1876474438098944:12345-192.168.201.16@tcp:400:kworker.0 00000100:00080000:2.0:1789545632.691509:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789545632.693190:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+10:2361:x1876474438098944:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 1770us (2063us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545632.693217:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 199 00000100:00100000:1.0:1789545632.694821:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+6:2361:x1876474438099072:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 3630us (3821us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545632.694834:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 47 00010000:00010000:3.0:1789545633.596532:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789545633.870243:0:9445:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00010000:00010000:0.0:1789545634.620600:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789545635.393209:0:9494:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Sep 16 04:00:34 EDT 2026 00010000:00010000:3.0:1789545635.647538:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545636.414951:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454908800:0@lo:400:kworker.0 00000100:00100000:2.0:1789545636.415033:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545636.415668:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789545636.415746:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454908416:0@lo:400:kworker.0 00000100:00100000:2.0:1789545636.415785:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545636.415813:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454908928:0@lo:400:kworker.0 00000100:00100000:2.0:1789545636.415838:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545636.415871:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc641ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454908544:0@lo:400:kworker.0 00000100:00100000:2.0:1789545636.415896:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545636.415917:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454909056:0@lo:400:kworker.0 00000100:00100000:2.0:1789545636.415953:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545636.415989:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789545636.415997:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454908672:0@lo:400:kworker.0 00000100:00100000:2.0:1789545636.416021:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545636.417169:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454908800 00000100:00100000:2.0:1789545636.417181:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454908800 00000100:00100000:2.0:1789545636.417250:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454909056 00000100:00100000:2.0:1789545636.417254:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454909056 00000100:00100000:2.0:1789545636.417281:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789545636.417289:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454908800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545636.417378:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454908800:12345-0@lo:400:kworker.0 Request processed in 89us (2345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545636.417384:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789545636.417405:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789545636.417411:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454909056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545636.417445:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454909056:12345-0@lo:400:kworker.0 Request processed in 35us (1492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545636.417451:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789545636.417488:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454908416 00000100:00100000:2.0:1789545636.417493:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454908416 00000100:00100000:2.0:1789545636.417521:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789545636.418571:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454908416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545636.418640:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454908416:12345-0@lo:400:kworker.0 Request processed in 1112us (2854us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545636.418648:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789545636.418710:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454908928 00000100:00100000:2.0:1789545636.418716:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454908928 00000100:00100000:2.0:1789545636.418742:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454908544 00000100:00100000:2.0:1789545636.418745:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454908544 00000100:00100000:2.0:1789545636.418756:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454908672 00000100:00100000:2.0:1789545636.418758:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454908672 00000100:00100000:2.0:1789545636.418772:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789545636.418778:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454908928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545636.418812:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454908928:12345-0@lo:400:kworker.0 Request processed in 34us (2973us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545636.418818:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789545636.418830:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789545636.418835:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454908544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545636.418864:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454908544:12345-0@lo:400:kworker.0 Request processed in 29us (2968us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545636.418869:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789545636.418882:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789545636.418887:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454908672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545636.418929:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454908672:12345-0@lo:400:kworker.0 Request processed in 41us (2907us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545636.418948:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1789545636.418993:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789545636.418998:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789545636.419001:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789545636.419066:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454908672:0@lo:400:kworker.0 00000100:00100000:2.0:1789545636.419081:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454908544:0@lo:400:kworker.0 00010000:00080000:2.0:1789545636.419095:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be54d0380 x1876474454909056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545636.419104:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454909056:0@lo:400:kworker.0 00000100:00100000:2.0:1789545636.419142:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc641ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454908416:0@lo:400:kworker.0 00000100:00100000:2.0:1789545636.419152:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454908928:0@lo:400:kworker.0 00010000:00080000:2.0:1789545636.419163:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be54d2d80 x1876474454908800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545636.419171:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454908800:0@lo:400:kworker.0 00010000:00010000:3.0:1789545636.671957:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545636.924762:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454909184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789545636.924836:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545636.925038:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454909184 00000100:00100000:0.0:1789545636.925047:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454909184 00000100:00100000:0.0:1789545636.925100:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789545636.925109:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454909184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789545636.925147:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789545636.925202:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454909184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545636.925209:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1789545636.925250:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bc9c8df80 x1876474454909184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545652 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545636.925268:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454909184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789545636.932523:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789545636.933635:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf6c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454909312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789545636.933710:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545636.937552:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454909312 00000100:00100000:1.0:1789545636.937569:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454909312 00000100:00100000:1.0:1789545636.937639:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789545636.937649:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454909312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789545636.937691:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789545636.937783:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454909312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (4072us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545636.937800:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1789545636.937898:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bdf6c1880 x1876474454909312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545652 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545636.937919:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf6c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454909312:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789545637.693840:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545637.812770:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545637.812886:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438099200 00000100:00100000:3.0:1789545637.812896:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438099200 00000100:00100000:3.0:1789545637.812961:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 201 00000100:00100000:3.0:1789545637.812973:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+10:2358:x1876474438099200:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:3.0:1789545637.813052:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+10:2358:x1876474438099200:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 81us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545637.813060:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 201 00000100:00100000:2.0:1789545637.820886:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545637.821120:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438099328 00000100:00100000:3.0:1789545637.821131:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438099328 00000100:00100000:3.0:1789545637.821208:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 51 00000100:00100000:3.0:1789545637.821222:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+6:2359:x1876474438099328:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:3.0:1789545637.821295:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+6:2359:x1876474438099328:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 78us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545637.821302:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 51 00000100:00080000:2.0:1789545637.821698:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789545638.717723:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545639.740626:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545640.764548:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545641.536936:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be5193100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454909824:0@lo:400:kworker.0 00000100:00100000:1.0:1789545641.537010:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545641.537074:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789545641.537081:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994becd93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454909440:0@lo:400:kworker.0 00000100:00100000:1.0:1789545641.537110:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545641.537135:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be5191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454909952:0@lo:400:kworker.0 00000100:00100000:1.0:1789545641.537161:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545641.537190:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be5190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454909568:0@lo:400:kworker.0 00000100:00100000:1.0:1789545641.537212:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545641.537226:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be5190700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454910080:0@lo:400:kworker.0 00000100:00100000:1.0:1789545641.537246:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545641.537265:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789545641.537271:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be5191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454909696:0@lo:400:kworker.0 00000100:00100000:1.0:1789545641.537293:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545641.537324:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454909824 00000100:00100000:1.0:1789545641.537332:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454909824 00000100:00100000:1.0:1789545641.537407:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454910080 00000100:00100000:1.0:1789545641.537411:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454910080 00000100:00100000:1.0:1789545641.537436:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789545641.537446:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454909824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545641.537579:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454909952 00000100:00100000:3.0:1789545641.537591:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454909952 00000100:00100000:3.0:1789545641.537615:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454909568 00000100:00100000:3.0:1789545641.537619:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454909568 00000100:00100000:3.0:1789545641.537632:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454909696 00000100:00100000:3.0:1789545641.537635:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454909696 00000100:00100000:3.0:1789545641.537665:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789545641.537671:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454909952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545641.537819:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454909952:12345-0@lo:400:kworker.0 Request processed in 146us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545641.537827:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789545641.537845:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789545641.537852:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454909568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545641.537902:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454909568:12345-0@lo:400:kworker.0 Request processed in 50us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545641.537908:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789545641.537920:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789545641.537927:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454909696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545641.537955:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454909696:12345-0@lo:400:kworker.0 Request processed in 29us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545641.537960:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789545641.538001:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be5191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454909696:0@lo:400:kworker.0 00000100:00100000:3.0:1789545641.538012:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be5190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454909568:0@lo:400:kworker.0 00000100:00100000:3.0:1789545641.538042:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be5191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454909952:0@lo:400:kworker.0 00000100:00100000:0.0:1789545641.538848:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789545641.538862:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5191500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454910080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545641.538932:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5191500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454910080:12345-0@lo:400:kworker.0 Request processed in 75us (1684us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545641.538939:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789545641.538968:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454909440 00000100:00100000:0.0:1789545641.538975:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454909440 00000100:00100000:0.0:1789545641.539003:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789545641.539010:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454909440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545641.539045:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454909440:12345-0@lo:400:kworker.0 Request processed in 35us (1934us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545641.539051:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:0.0:1789545641.539092:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789545641.539105:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789545641.539108:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789545641.539217:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be5190700 x1876474454910080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545641.539240:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be5190700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454910080:0@lo:400:kworker.0 00000100:00100000:3.0:1789545641.539272:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994becd93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454909440:0@lo:400:kworker.0 00000100:00100000:1.0:1789545641.540540:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454909824:12345-0@lo:400:kworker.0 Request processed in 3090us (3525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545641.540550:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1789545641.540862:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be5193100 x1876474454909824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545641.540876:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be5193100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454909824:0@lo:400:kworker.0 00010000:00010000:3.0:1789545641.788761:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545642.046540:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789545642.046565:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454910208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789545642.046636:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545642.046721:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454910208 00000100:00100000:0.0:1789545642.046728:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454910208 00000100:00100000:0.0:1789545642.046778:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789545642.046787:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454910208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789545642.046826:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789545642.046869:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454910208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545642.046889:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1789545642.046930:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bc9c8df80 x1876474454910208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545658 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545642.046949:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454910208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789545642.055957:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454910336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789545642.056041:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545642.056273:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454910336 00000100:00100000:1.0:1789545642.056282:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454910336 00000100:00100000:1.0:1789545642.056332:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789545642.056343:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454910336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789545642.058574:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789545642.058670:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454910336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2325us (2625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545642.058680:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1789545642.058742:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bc9c8df80 x1876474454910336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545658 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545642.058764:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454910336:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789545642.812896:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545642.933890:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545642.933951:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545642.934031:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438099584 00000100:00100000:0.0:1789545642.934046:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438099584 00000100:00100000:0.0:1789545642.934140:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 55 00000100:00100000:0.0:1789545642.934154:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+6:2358:x1876474438099584:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:0.0:1789545642.934254:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+6:2358:x1876474438099584:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 103us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545642.934262:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 55 00000100:00100000:3.0:1789545642.934449:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438099456 00000100:00100000:3.0:1789545642.934455:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438099456 00000100:00100000:3.0:1789545642.934503:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 203 00000100:00100000:3.0:1789545642.934512:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+10:2358:x1876474438099456:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:3.0:1789545642.934555:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+10:2358:x1876474438099456:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 44us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545642.934563:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 203 00000100:00080000:1.0:1789545642.934736:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789545643.836647:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545644.860664:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545645.885087:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545646.652563:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be5192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454910464:0@lo:400:kworker.0 00000100:00100000:1.0:1789545646.652642:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545646.652703:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be5192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454910976:0@lo:400:kworker.0 00000100:00100000:1.0:1789545646.652742:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545646.652770:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789545646.652776:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be5193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454910848:0@lo:400:kworker.0 00000100:00100000:1.0:1789545646.652812:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545646.652845:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be5192300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454910592:0@lo:400:kworker.0 00000100:00100000:1.0:1789545646.652866:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545646.652883:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be5190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454911104:0@lo:400:kworker.0 00000100:00100000:1.0:1789545646.652932:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545646.652954:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789545646.652959:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be5193800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454910720:0@lo:400:kworker.0 00000100:00100000:1.0:1789545646.653828:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545646.653880:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454910464 00000100:00100000:1.0:1789545646.653888:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454910464 00000100:00100000:1.0:1789545646.659574:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789545646.659811:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3312:x1876474454910464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545646.660086:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3312:x1876474454910464:12345-0@lo:400:kworker.0 Request processed in 497us (7442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545646.660095:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789545646.660142:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454910976 00000100:00100000:1.0:1789545646.660150:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454910976 00000100:00100000:1.0:1789545646.660201:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454910592 00000100:00100000:1.0:1789545646.660204:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454910592 00000100:00100000:1.0:1789545646.660215:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454910720 00000100:00100000:1.0:1789545646.660218:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454910720 00000100:00100000:1.0:1789545646.660236:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789545646.660241:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454910976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545646.660275:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454910976:12345-0@lo:400:kworker.0 Request processed in 33us (7533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545646.660281:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789545646.660292:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789545646.660298:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454910592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545646.660330:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454910592:12345-0@lo:400:kworker.0 Request processed in 32us (7462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545646.660336:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789545646.660412:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789545646.660420:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454910720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545646.660453:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454910720:12345-0@lo:400:kworker.0 Request processed in 35us (6628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545646.660458:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789545646.660480:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454910848 00000100:00100000:1.0:1789545646.660484:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454910848 00000100:00100000:1.0:1789545646.660512:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454911104 00000100:00100000:1.0:1789545646.660516:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454911104 00000100:00100000:1.0:1789545646.660534:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789545646.660540:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454910848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545646.660572:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454910848:12345-0@lo:400:kworker.0 Request processed in 32us (7759us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545646.660578:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789545646.660590:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789545646.660609:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454911104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545646.660637:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454911104:12345-0@lo:400:kworker.0 Request processed in 42us (7705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545646.660643:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789545646.660742:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be5193800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454910720:0@lo:400:kworker.0 00000100:00100000:1.0:1789545646.660757:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be5192300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454910592:0@lo:400:kworker.0 00010000:00080000:1.0:1789545646.660770:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be5190000 x1876474454911104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545646.660781:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be5190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454911104:0@lo:400:kworker.0 00000100:00080000:2.0:1789545646.663769:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789545646.663778:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789545646.663782:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789545646.665860:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be5192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454910464:0@lo:400:kworker.0 00000100:00100000:3.0:1789545646.665886:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be5192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454910976:0@lo:400:kworker.0 00010000:00080000:3.0:1789545646.666519:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be5193480 x1876474454910848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545646.666534:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be5193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454910848:0@lo:400:kworker.0 00010000:00010000:2.0:1789545646.909583:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789545647.168965:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf6c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454911232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789545647.169034:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545647.169130:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454911232 00000100:00100000:3.0:1789545647.169138:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454911232 00000100:00100000:3.0:1789545647.169194:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789545647.169203:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf6c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454911232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789545647.169237:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789545647.169285:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf6c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454911232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545647.169292:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1789545647.169334:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bdf6c1880 x1876474454911232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545663 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545647.169353:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf6c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454911232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789545647.172442:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789545647.172465:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be5190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454911360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789545647.172539:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545647.172729:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454911360 00000100:00100000:1.0:1789545647.172746:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454911360 00000100:00100000:1.0:1789545647.172803:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789545647.172813:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf6c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454911360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789545647.172848:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789545647.172897:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf6c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454911360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545647.172905:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1789545647.172944:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be5190000 x1876474454911360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545663 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545647.172965:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be5190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454911360:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789545647.940233:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545648.059792:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545648.059838:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545648.059926:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438099712 00000100:00100000:2.0:1789545648.059937:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438099712 00000100:00100000:2.0:1789545648.060001:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 205 00000100:00100000:2.0:1789545648.060012:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+10:2361:x1876474438099712:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545648.060082:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+10:2361:x1876474438099712:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 72us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545648.060090:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 205 00000100:00100000:1.0:1789545648.060874:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438099840 00000100:00100000:1.0:1789545648.060882:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438099840 00000100:00100000:1.0:1789545648.060926:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 59 00000100:00100000:1.0:1789545648.060934:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+6:2361:x1876474438099840:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545648.060982:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+6:2361:x1876474438099840:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 49us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545648.060989:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 59 00000100:00080000:2.0:1789545648.062274:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789545648.957646:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545649.981594:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545651.005488:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789545651.772546:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf6c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454911616:0@lo:400:kworker.0 00000100:00100000:3.0:1789545651.772618:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545651.772674:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf6c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454912128:0@lo:400:kworker.0 00000100:00100000:3.0:1789545651.772697:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545651.772734:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf6c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454911488:0@lo:400:kworker.0 00000100:00100000:3.0:1789545651.772742:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789545651.772747:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf6c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454911744:0@lo:400:kworker.0 00000100:00100000:3.0:1789545651.772768:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545651.772768:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545651.772791:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf6c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454912000:0@lo:400:kworker.0 00000100:00100000:3.0:1789545651.772804:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454911616 00000100:00100000:1.0:1789545651.772811:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545651.772812:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454911616 00000100:00100000:1.0:1789545651.772829:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789545651.772834:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf6c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454911872:0@lo:400:kworker.0 00000100:00100000:3.0:1789545651.772848:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454911744 00000100:00100000:3.0:1789545651.772851:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454911744 00000100:00100000:1.0:1789545651.772852:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545651.772873:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454912000 00000100:00100000:1.0:1789545651.772874:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454911488 00000100:00100000:3.0:1789545651.772883:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454912000 00000100:00100000:1.0:1789545651.772883:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454911488 00000100:00100000:3.0:1789545651.772900:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789545651.772905:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789545651.772908:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf6c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454911616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545651.772910:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3312:x1876474454911488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545651.772953:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf6c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454911616:12345-0@lo:400:kworker.0 Request processed in 45us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545651.772953:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3312:x1876474454911488:12345-0@lo:400:kworker.0 Request processed in 42us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545651.772961:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789545651.772961:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789545651.772979:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789545651.772984:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454911744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545651.773003:0:5847:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789545651.773010:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454911744:12345-0@lo:400:kworker.0 Request processed in 26us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545651.773010:0:5847:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789545651.773015:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789545651.773027:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789545651.773027:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454912128 00000100:00100000:1.0:1789545651.773030:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454912128 00000100:00100000:3.0:1789545651.773033:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454912000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545651.773053:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454911872 00000100:00100000:1.0:1789545651.773056:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454911872 00000100:00100000:3.0:1789545651.773058:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454912000:12345-0@lo:400:kworker.0 Request processed in 27us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545651.773064:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789545651.773074:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789545651.773080:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789545651.773080:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf6c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454912128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545651.773085:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454911872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545651.773107:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454911872:12345-0@lo:400:kworker.0 Request processed in 22us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545651.773107:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf6c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454912128:12345-0@lo:400:kworker.0 Request processed in 28us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545651.773113:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1789545651.773249:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789545651.773253:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789545651.773256:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789545651.773283:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf6c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454911744:0@lo:400:kworker.0 00000100:00100000:3.0:1789545651.773295:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf6c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454911616:0@lo:400:kworker.0 00010000:00080000:3.0:1789545651.773326:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bdf6c3480 x1876474454912128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545651.773337:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf6c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454912128:0@lo:400:kworker.0 00000100:00100000:1.0:1789545651.773410:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1789545651.773508:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bdf6c2300 x1876474454911872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545651.773517:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf6c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454911872:0@lo:400:kworker.0 00000100:00100000:1.0:1789545651.773525:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf6c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454911488:0@lo:400:kworker.0 00000100:00100000:1.0:1789545651.773532:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf6c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454912000:0@lo:400:kworker.0 00000001:02000400:0.0:1789545651.786949:0:10124:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 04:00:50 (1789545650) === 00010000:00010000:3.0:1789545652.029671:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545652.284603:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be5193800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454912256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789545652.284759:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545652.287570:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789545652.287592:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454912384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789545652.287673:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545652.292592:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454912256 00000100:00100000:1.0:1789545652.292606:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454912256 00000100:00100000:1.0:1789545652.292667:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454912384 00000100:00100000:1.0:1789545652.292671:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454912384 00000100:00100000:1.0:1789545652.292698:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789545652.292722:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454912256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789545652.292763:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789545652.292851:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454912256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (8091us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545652.292857:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789545652.292873:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789545652.292880:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf6c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454912384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789545652.292901:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789545652.292954:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf6c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454912384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (5281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545652.292961:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1789545652.294074:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bc9c8d500 x1876474454912384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545668 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545652.294098:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454912384:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789545652.294763:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be5193800 x1876474454912256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545668 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545652.294776:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be5193800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454912256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789545652.305641:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545652.307544:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438099968 00000100:00100000:1.0:1789545652.307561:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438099968 00000100:00100000:1.0:1789545652.307702:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 207 00000100:00100000:1.0:1789545652.307715:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+10:8151:x1876474438099968:12345-192.168.201.16@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789545652.307734:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545652.307751:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc8ba9a00/0x64919c0f856c069a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5362 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545652.307780:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc8ba9a00/0x64919c0f856c069a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5362 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545652.307790:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc8ba9a00/0x64919c0f856c069a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5362 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545652.307799:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba9a00, rc 0) 00000100:00100000:1.0:1789545652.307860:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+11:8151:x1876474438099968:12345-192.168.201.16@tcp:101:mount.lustre.0 Request processed in 149us (2230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545652.307883:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 207 00000100:00100000:1.0:1789545652.321852:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545652.322728:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438100096 00000100:00100000:2.0:1789545652.322740:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438100096 00000100:00100000:2.0:1789545652.322806:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 208 00000100:00100000:2.0:1789545652.322818:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+11:8151:x1876474438100096:12345-192.168.201.16@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789545652.323151:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+11:8151:x1876474438100096:12345-192.168.201.16@tcp:501:mount.lustre.0 Request processed in 334us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545652.323160:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 208 00000100:00100000:0.0:1789545652.328652:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545652.328741:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438100224 00000100:00100000:1.0:1789545652.328753:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438100224 00000100:00100000:1.0:1789545652.328815:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 209 00000100:00100000:1.0:1789545652.328826:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8dde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+11:8151:x1876474438100224:12345-192.168.201.16@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789545652.329053:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8dde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+11:8151:x1876474438100224:12345-192.168.201.16@tcp:503:mount.lustre.0 Request processed in 228us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545652.329060:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 209 00000100:00100000:0.0:1789545652.344460:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545652.344728:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438100352 00000100:00100000:1.0:1789545652.344739:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438100352 00000100:00100000:1.0:1789545652.344801:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 210 00000100:00100000:1.0:1789545652.344811:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+11:8155:x1876474438100352:12345-192.168.201.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789545652.345099:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+11:8155:x1876474438100352:12345-192.168.201.16@tcp:502:llog_process_th.0 Request processed in 289us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545652.345107:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 210 00000100:00100000:0.0:1789545652.378610:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545652.378725:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438100480 00000100:00100000:3.0:1789545652.378735:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438100480 00000100:00100000:3.0:1789545652.378797:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 211 00000100:00100000:3.0:1789545652.378809:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+11:8155:x1876474438100480:12345-192.168.201.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789545652.379125:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+11:8155:x1876474438100480:12345-192.168.201.16@tcp:502:llog_process_th.0 Request processed in 317us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545652.379133:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 211 00000100:00100000:2.0:1789545652.384028:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545652.384140:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438100608 00000100:00100000:0.0:1789545652.384151:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438100608 00000100:00100000:0.0:1789545652.384219:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 212 00000100:00100000:0.0:1789545652.384229:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+11:8151:x1876474438100608:12345-192.168.201.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789545652.384246:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545652.384263:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc0031a00/0x64919c0f856c06a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de538c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545652.384289:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc0031a00/0x64919c0f856c06a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de538c expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545652.384300:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc0031a00/0x64919c0f856c06a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de538c expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545652.384309:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc0031a00, rc 0) 00000100:00100000:0.0:1789545652.384418:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+12:8151:x1876474438100608:12345-192.168.201.16@tcp:101:mount.lustre.0 Request processed in 190us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545652.384425:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 212 00000100:00100000:0.0:1789545652.391017:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545652.391130:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438100736 00000100:00100000:1.0:1789545652.391141:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438100736 00000100:00100000:1.0:1789545652.391208:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 213 00000100:00100000:1.0:1789545652.391217:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+12:8151:x1876474438100736:12345-192.168.201.16@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789545652.391243:0:5840:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789545652.391265:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789545652.391269:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789545652.391272:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789545652.391274:0:5840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1789545652.402052:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+12:8151:x1876474438100736:12345-192.168.201.16@tcp:256:mount.lustre.0 Request processed in 10825us (11035us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545652.402068:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 213 00000100:00100000:2.0:1789545652.409835:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545652.409929:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438100864 00000100:00100000:3.0:1789545652.409940:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438100864 00000100:00100000:3.0:1789545652.410001:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 214 00000100:00100000:3.0:1789545652.410011:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+12:8151:x1876474438100864:12345-192.168.201.16@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789545652.410026:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545652.410042:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994c0217e400/0x64919c0f856c06a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5393 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545652.410084:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994c0217e400/0x64919c0f856c06a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5393 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545652.410095:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994c0217e400/0x64919c0f856c06a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5393 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545652.410104:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217e400, rc 0) 00000100:00100000:3.0:1789545652.410158:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+13:8151:x1876474438100864:12345-192.168.201.16@tcp:101:mount.lustre.0 Request processed in 149us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545652.410164:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 214 00000100:00100000:0.0:1789545652.426758:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545652.427338:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438100992 00000100:00100000:2.0:1789545652.427348:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438100992 00000100:00100000:2.0:1789545652.428780:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 215 00000100:00100000:2.0:1789545652.428790:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+13:8151:x1876474438100992:12345-192.168.201.16@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789545652.429085:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+13:8151:x1876474438100992:12345-192.168.201.16@tcp:501:mount.lustre.0 Request processed in 295us (2334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545652.429093:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 215 00000100:00100000:1.0:1789545652.435727:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545652.435984:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438101120 00000100:00100000:0.0:1789545652.435995:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438101120 00000100:00100000:0.0:1789545652.436051:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 216 00000100:00100000:0.0:1789545652.436060:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+13:8151:x1876474438101120:12345-192.168.201.16@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789545652.436310:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+13:8151:x1876474438101120:12345-192.168.201.16@tcp:503:mount.lustre.0 Request processed in 249us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545652.436319:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 216 00000100:00100000:0.0:1789545652.443934:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545652.444193:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438101248 00000100:00100000:3.0:1789545652.444203:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438101248 00000100:00100000:3.0:1789545652.444255:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 217 00000100:00100000:3.0:1789545652.444263:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+13:8158:x1876474438101248:12345-192.168.201.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789545652.444563:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+13:8158:x1876474438101248:12345-192.168.201.16@tcp:502:llog_process_th.0 Request processed in 300us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545652.444569:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 217 00000100:00100000:1.0:1789545652.454809:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545652.454909:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438101376 00000100:00100000:2.0:1789545652.454920:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438101376 00000100:00100000:2.0:1789545652.454977:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 218 00000100:00100000:2.0:1789545652.454987:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+13:8158:x1876474438101376:12345-192.168.201.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789545652.455240:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+13:8158:x1876474438101376:12345-192.168.201.16@tcp:502:llog_process_th.0 Request processed in 254us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545652.455248:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 218 00000100:00100000:1.0:1789545652.468157:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545652.468316:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438101632 00000100:00100000:3.0:1789545652.468327:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438101632 00000100:00100000:3.0:1789545652.468445:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 63 00000100:00100000:3.0:1789545652.468456:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+6:2360:x1876474438101632:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:3.0:1789545652.468549:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+6:2360:x1876474438101632:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 96us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545652.468557:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 63 00000100:00100000:3.0:1789545652.468602:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545652.468728:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438101504 00000100:00100000:3.0:1789545652.468733:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438101504 00000100:00100000:3.0:1789545652.468755:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10 00000100:00100000:3.0:1789545652.468759:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2357:x1876474438101504:12345-192.168.201.16@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789545652.468783:0:5847:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 347985d0-1f2a-4d4d-ae4d-f363a612744e@192.168.201.16@tcp t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:3.0:1789545652.468857:0:5847:0:(genops.c:1384:class_connect()) connect: client 347985d0-1f2a-4d4d-ae4d-f363a612744e, cookie 0x64919c0f856c06af 00000004:00100000:3.0:1789545652.468889:0:5847:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789545652.469159:0:5847:0:(import.c:65:import_set_state_nolock()) ffff994be4c9d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789545652.469197:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:347985d0-1f2a-4d4d-ae4d-f363a612744e+6:2357:x1876474438101504:12345-192.168.201.16@tcp:38:mount.lustre.0 Request processed in 436us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545652.469203:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10 00000100:00080000:2.0:1789545652.469852:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789545652.483888:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545652.483945:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545652.484051:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438101760 00000100:00100000:1.0:1789545652.484061:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438101760 00000100:00100000:1.0:1789545652.484137:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438101888 00000100:00100000:1.0:1789545652.484141:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438101888 00000100:00100000:1.0:1789545652.484167:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11 00000100:00100000:1.0:1789545652.484177:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf6c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+7:0:x1876474438101760:12345-192.168.201.16@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789545652.484224:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789545652.484314:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf6c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+7:0:x1876474438101760:12345-192.168.201.16@tcp:41:mount.lustre.0 Request processed in 139us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545652.484321:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11 00000100:00100000:1.0:1789545652.484341:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12 00000100:00100000:1.0:1789545652.484347:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf6c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+6:8151:x1876474438101888:12345-192.168.201.16@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789545652.484392:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789545652.484433:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf6c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+6:8151:x1876474438101888:12345-192.168.201.16@tcp:41:mount.lustre.0 Request processed in 85us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545652.484440:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12 00000100:00080000:2.0:1789545652.484718:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789545652.497747:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545652.503706:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438102016 00000100:00100000:3.0:1789545652.503723:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438102016 00000100:00100000:3.0:1789545652.503807:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 13 00000100:00100000:3.0:1789545652.503819:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+6:8151:x1876474438102016:12345-192.168.201.16@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789545652.503914:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+6:8151:x1876474438102016:12345-192.168.201.16@tcp:40:mount.lustre.0 Request processed in 97us (6176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545652.503921:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 13 00000100:00100000:1.0:1789545652.507413:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545652.507459:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545652.507526:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545652.507723:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438102144 00000100:00100000:3.0:1789545652.507733:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438102144 00000100:00100000:3.0:1789545652.507771:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438102272 00000100:00100000:3.0:1789545652.507774:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438102272 00000100:00100000:3.0:1789545652.507794:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12 00000100:00100000:3.0:1789545652.507802:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1876474438102144:12345-192.168.201.16@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789545652.507834:0:6691:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 347985d0-1f2a-4d4d-ae4d-f363a612744e@192.168.201.16@tcp t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:3.0:1789545652.507887:0:6691:0:(genops.c:1384:class_connect()) connect: client 347985d0-1f2a-4d4d-ae4d-f363a612744e, cookie 0x64919c0f856c06b6 00002000:00100000:3.0:1789545652.507899:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 347985d0-1f2a-4d4d-ae4d-f363a612744e/ffff994be4c9e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789545652.507910:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789545652.508145:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789545652.508181:0:6691:0:(import.c:65:import_set_state_nolock()) ffff994be4c98800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789545652.508246:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+6:2357:x1876474438102144:12345-192.168.201.16@tcp:8:mount.lustre.0 Request processed in 443us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545652.508254:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12 00000100:00100000:3.0:1789545652.508287:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 13 00000100:00100000:3.0:1789545652.508293:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1876474438102272:12345-192.168.201.16@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789545652.508307:0:6691:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 347985d0-1f2a-4d4d-ae4d-f363a612744e@192.168.201.16@tcp t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:3.0:1789545652.508322:0:6691:0:(genops.c:1384:class_connect()) connect: client 347985d0-1f2a-4d4d-ae4d-f363a612744e, cookie 0x64919c0f856c06bd 00002000:00100000:3.0:1789545652.508327:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 347985d0-1f2a-4d4d-ae4d-f363a612744e/ffff994be4c9f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789545652.508333:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789545652.508519:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789545652.508535:0:6691:0:(import.c:65:import_set_state_nolock()) ffff994be4c99800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789545652.508561:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+6:2357:x1876474438102272:12345-192.168.201.16@tcp:8:mount.lustre.0 Request processed in 267us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545652.508568:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 13 00000100:00100000:2.0:1789545652.509038:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438102400 00000100:00100000:2.0:1789545652.509045:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438102400 00000100:00100000:2.0:1789545652.509092:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1 00000100:00100000:2.0:1789545652.509101:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+6:8151:x1876474438102400:12345-192.168.201.16@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789545652.509169:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789545652.509220:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+6:8151:x1876474438102400:12345-192.168.201.16@tcp:33:mount.lustre.0 Request processed in 121us (1817us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545652.509227:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1 00010000:00010000:2.0:1789545653.052880:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545654.077859:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545655.100872:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545656.124559:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789545656.440757:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 347985d0-1f2a-4d4d-ae4d-f363a612744e 00000100:00100000:3.0:1789545656.892775:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf6c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876474454912768:0@lo:400:kworker.0 00000100:00100000:0.0:1789545656.892817:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf6c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454912640:0@lo:400:kworker.0 00000100:00100000:3.0:1789545656.892846:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545656.892882:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454912768 00000100:00100000:0.0:1789545656.892891:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454912768 00000100:00100000:0.0:1789545656.892958:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789545656.892970:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876474454912768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545656.893018:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf6c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454912512:0@lo:400:kworker.0 00000100:00100000:0.0:1789545656.893035:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876474454912768:12345-0@lo:400:kworker.0 Request processed in 69us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545656.893042:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789545656.893052:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545656.893082:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545656.893145:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454912640 00000100:00100000:3.0:1789545656.893150:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454912640 00000100:00100000:3.0:1789545656.893183:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789545656.893204:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454912640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545656.893222:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454912512 00000100:00100000:1.0:1789545656.893226:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454912512 00000100:00100000:2.0:1789545656.893251:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf6c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454913024:0@lo:400:kworker.0 00000100:00100000:1.0:1789545656.893513:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789545656.893527:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3312:x1876474454912512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545656.896114:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf6c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454913152:0@lo:400:kworker.0 00000100:00100000:0.0:1789545656.896193:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545656.896507:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf6c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454912896:0@lo:400:kworker.0 00000100:00100000:0.0:1789545656.896538:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789545656.896570:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789545656.896619:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454913152 00000100:00100000:0.0:1789545656.896628:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454913152 00000100:00100000:0.0:1789545656.896681:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454912896 00000100:00100000:0.0:1789545656.896685:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454912896 00000100:00100000:0.0:1789545656.896710:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789545656.896720:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454913152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545656.896774:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454913152:12345-0@lo:400:kworker.0 Request processed in 56us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545656.896780:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789545656.896800:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789545656.896806:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454912896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545656.896840:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454912896:12345-0@lo:400:kworker.0 Request processed in 33us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545656.896845:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1789545656.896860:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789545656.896863:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789545656.896888:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bdf6c0700 x1876474454912896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545656.896908:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf6c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454912896:0@lo:400:kworker.0 00010000:00080000:0.0:1789545656.896938:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bdf6c3100 x1876474454913152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545656.896946:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf6c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454913152:0@lo:400:kworker.0 00000100:00100000:3.0:1789545656.897597:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf6c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876474454912768:0@lo:400:kworker.0 00000100:00100000:3.0:1789545656.897664:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454912640:12345-0@lo:400:kworker.0 Request processed in 4461us (4586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545656.897673:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789545656.897727:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf6c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454912640:0@lo:400:kworker.0 00000100:00100000:2.0:1789545656.901097:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545656.901151:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454913024 00000100:00100000:2.0:1789545656.901161:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454913024 00000100:00100000:2.0:1789545656.901236:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789545656.901246:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454913024:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789545656.901356:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789545656.901422:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454913024:12345-0@lo:400:kworker.0 Request processed in 177us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545656.901430:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789545656.901477:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf6c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454913024:0@lo:400:kworker.0 00000100:00100000:1.0:1789545656.902469:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3312:x1876474454912512:12345-0@lo:400:kworker.0 Request processed in 8938us (9411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545656.902480:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789545656.902590:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf6c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454912512:0@lo:400:kworker.0 00000001:00100000:3.0:1789545656.993492:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 347985d0-1f2a-4d4d-ae4d-f363a612744e 00010000:00010000:0.0:1789545657.149727:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545657.404638:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789545657.404661:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454913280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789545657.404733:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545657.404918:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454913280 00000100:00100000:0.0:1789545657.404927:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454913280 00000100:00100000:0.0:1789545657.404983:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789545657.405008:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454913280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789545657.405058:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789545657.405117:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454913280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545657.405135:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1789545657.405342:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bc9c8f480 x1876474454913280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545673 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545657.405392:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454913280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789545657.405799:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789545657.405813:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454913408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789545657.405854:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545657.405939:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454913408 00000100:00100000:1.0:1789545657.405946:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454913408 00000100:00100000:1.0:1789545657.405972:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789545657.405980:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454913408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789545657.406004:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789545657.406061:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454913408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545657.406068:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1789545657.406759:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be4edf480 x1876474454913408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545673 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545657.406777:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454913408:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1789545657.446804:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 347985d0-1f2a-4d4d-ae4d-f363a612744e 00000100:00100000:0.0:1789545657.778170:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545657.778217:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545657.778254:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545657.778286:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545657.778308:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545657.778341:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438102912 00000100:00100000:0.0:1789545657.778350:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438102912 00000100:00100000:0.0:1789545657.778434:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438103040 00000100:00100000:0.0:1789545657.778438:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438103040 00000100:00100000:0.0:1789545657.778465:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 38 00000100:00100000:0.0:1789545657.778475:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2358:x1876474438102912:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545657.778507:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438102528 00000100:00100000:2.0:1789545657.778513:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438102528 00000100:00100000:2.0:1789545657.778551:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 220 00000100:00100000:0.0:1789545657.778553:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2358:x1876474438102912:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 78us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545657.778562:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2358:x1876474438102528:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545657.778604:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2358:x1876474438102528:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 33us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545657.778613:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 220 00000100:00100000:3.0:1789545657.778616:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438102656 00000100:00100000:3.0:1789545657.778622:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438102656 00000100:00100000:3.0:1789545657.778665:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438102784 00000100:00100000:3.0:1789545657.778669:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438102784 00000100:00100000:2.0:1789545657.778676:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 67 00000100:00100000:2.0:1789545657.778686:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+6:2358:x1876474438102656:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:3.0:1789545657.778695:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 68 00000100:00100000:3.0:1789545657.778705:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf6c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2358:x1876474438102784:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545657.778719:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+6:2358:x1876474438102656:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 34us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545657.778726:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 67 00000100:00100000:3.0:1789545657.778744:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf6c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2358:x1876474438102784:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 40us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545657.778964:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 68 00000100:00100000:1.0:1789545657.781387:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 39 00000100:00100000:1.0:1789545657.781414:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf6c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2358:x1876474438103040:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545657.781494:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf6c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2358:x1876474438103040:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 94us (3184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545657.781503:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 39 00000100:00100000:0.0:1789545657.784980:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 38 00000100:00080000:2.0:1789545657.785222:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789545657.785230:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789545657.785248:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789545658.173791:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789545658.226039:0:10319:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg116-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1789545659.196630:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545660.225404:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545661.245427:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545662.013180:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454913920:0@lo:400:kworker.0 00000100:00100000:1.0:1789545662.013263:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545662.013326:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789545662.013333:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454913536:0@lo:400:kworker.0 00000100:00100000:1.0:1789545662.013376:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545662.013398:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454914048:0@lo:400:kworker.0 00000100:00100000:2.0:1789545662.013407:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454913920 00000100:00100000:2.0:1789545662.013415:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454913920 00000100:00100000:1.0:1789545662.013421:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545662.013446:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454913536 00000100:00100000:1.0:1789545662.013449:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454913536 00000100:00100000:2.0:1789545662.013464:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789545662.013470:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789545662.013473:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454913920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545662.013475:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454913536:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789545662.013569:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789545662.013583:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454914048 00000100:00100000:0.0:1789545662.013587:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454914048 00000100:00100000:0.0:1789545662.013635:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789545662.013642:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454914048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545662.013691:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454913920:12345-0@lo:400:kworker.0 Request processed in 219us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545662.013699:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789545662.013740:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876474454913792:0@lo:400:kworker.0 00000100:00100000:1.0:1789545662.019373:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454913536:12345-0@lo:400:kworker.0 Request processed in 5870us (5969us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545662.019390:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789545662.019488:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454913664:0@lo:400:kworker.0 00000100:00100000:1.0:1789545662.019553:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545662.019598:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4eddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454914176:0@lo:400:kworker.0 00000100:00100000:1.0:1789545662.019623:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789545662.019668:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789545662.019690:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454914176 00000100:00100000:1.0:1789545662.019698:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454914176 00000100:00100000:1.0:1789545662.019748:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789545662.019756:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454914176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545662.019804:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454914176:12345-0@lo:400:kworker.0 Request processed in 48us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545662.019810:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1789545662.019824:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789545662.020550:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be4eddc00 x1876474454914176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545662.020567:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4eddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454914176:0@lo:400:kworker.0 00000100:00100000:1.0:1789545662.020629:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454913664 00000100:00100000:1.0:1789545662.020635:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454913664 00000100:00100000:1.0:1789545662.020670:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789545662.020677:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454913664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545662.020729:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454913664:12345-0@lo:400:kworker.0 Request processed in 52us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545662.020736:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789545662.020763:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454913664:0@lo:400:kworker.0 00000100:00100000:1.0:1789545662.021818:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545662.023263:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454914048:12345-0@lo:400:kworker.0 Request processed in 9614us (9832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545662.023277:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789545662.023434:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454913536:0@lo:400:kworker.0 00000100:00100000:2.0:1789545662.023453:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454914048:0@lo:400:kworker.0 00010000:00080000:2.0:1789545662.023468:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be4edd180 x1876474454913920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545662.023479:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454913920:0@lo:400:kworker.0 00000100:00100000:0.0:1789545662.024161:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454913792 00000100:00100000:0.0:1789545662.024171:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454913792 00000100:00080000:2.0:1789545662.024395:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789545662.025471:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789545662.025489:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876474454913792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545662.025689:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876474454913792:12345-0@lo:400:kworker.0 Request processed in 206us (3872us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545662.025697:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789545662.029540:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876474454913792:0@lo:400:kworker.0 00010000:00010000:2.0:1789545662.269205:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545662.525079:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfc51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454914304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789545662.525156:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545662.525288:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454914304 00000100:00100000:2.0:1789545662.525298:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454914304 00000100:00100000:2.0:1789545662.525353:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789545662.525387:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454914304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789545662.525420:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789545662.525477:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454914304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545662.525484:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1789545662.525559:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bdfc51500 x1876474454914304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545678 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545662.525789:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfc51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454914304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789545662.536031:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789545662.536058:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4eddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454914432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789545662.538878:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545662.538947:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454914432 00000100:00100000:0.0:1789545662.538956:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454914432 00000100:00100000:0.0:1789545662.539006:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789545662.539016:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf6c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454914432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789545662.539053:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789545662.539112:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf6c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454914432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545662.539119:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1789545662.539164:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be4eddc00 x1876474454914432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545678 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545662.539183:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4eddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454914432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789545662.916551:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545662.916603:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545662.916641:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545662.916663:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545662.916691:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545662.916729:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438103680 00000100:00100000:1.0:1789545662.916739:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438103680 00000100:00100000:1.0:1789545662.916816:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438103552 00000100:00100000:1.0:1789545662.916820:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438103552 00000100:00100000:1.0:1789545662.916848:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 42 00000100:00100000:1.0:1789545662.916860:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2358:x1876474438103680:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545662.916962:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2358:x1876474438103680:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 103us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545662.916971:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 42 00000100:00100000:1.0:1789545662.917256:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 43 00000100:00100000:1.0:1789545662.917266:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2358:x1876474438103552:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545662.917317:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2358:x1876474438103552:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 53us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545662.917554:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 43 00000100:00080000:1.0:1789545662.917579:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789545662.917583:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789545662.917763:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438103168 00000100:00100000:0.0:1789545662.917769:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438103168 00000100:00100000:0.0:1789545662.917811:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 222 00000100:00100000:0.0:1789545662.917828:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2358:x1876474438103168:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:0.0:1789545662.917960:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2358:x1876474438103168:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 133us (1418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545662.917982:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 222 00000100:00100000:3.0:1789545662.918345:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438103424 00000100:00100000:3.0:1789545662.918351:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438103424 00000100:00100000:3.0:1789545662.918415:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438103296 00000100:00100000:3.0:1789545662.918419:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438103296 00000100:00100000:3.0:1789545662.918444:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 72 00000100:00100000:3.0:1789545662.918470:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2358:x1876474438103424:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:3.0:1789545662.918581:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2358:x1876474438103424:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 117us (1963us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545662.918587:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 72 00000100:00100000:3.0:1789545662.918601:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 73 00000100:00100000:3.0:1789545662.918608:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+6:2358:x1876474438103296:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:3.0:1789545662.918633:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+6:2358:x1876474438103296:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 25us (1969us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545662.918639:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 73 00000100:00080000:0.0:1789545662.919126:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789545663.296070:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545664.316777:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545665.342134:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545666.364596:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545667.133519:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454914560:0@lo:400:kworker.0 00000100:00100000:1.0:1789545667.133591:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545667.134246:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454914944:0@lo:400:kworker.0 00000100:00100000:2.0:1789545667.134286:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545667.134356:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454915072:0@lo:400:kworker.0 00000100:00100000:1.0:1789545667.134706:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545667.134799:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454914688:0@lo:400:kworker.0 00000100:00100000:1.0:1789545667.134825:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545667.141722:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876474454914816:0@lo:400:kworker.0 00000100:00100000:1.0:1789545667.141789:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545667.144852:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454915072 00000100:00100000:3.0:1789545667.144868:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454915072 00000100:00100000:3.0:1789545667.144948:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454914688 00000100:00100000:3.0:1789545667.144953:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454914688 00000100:00100000:3.0:1789545667.144977:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789545667.144986:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454915072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545667.145105:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454915072:12345-0@lo:400:kworker.0 Request processed in 119us (10397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545667.145113:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789545667.145131:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789545667.145137:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454914688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545667.145166:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454914688:12345-0@lo:400:kworker.0 Request processed in 29us (10340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545667.145172:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1789545667.145484:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789545667.145667:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454915072:0@lo:400:kworker.0 00000100:00100000:3.0:1789545667.147133:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454914944 00000100:00100000:3.0:1789545667.147145:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454914944 00000100:00100000:3.0:1789545667.147459:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789545667.147472:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454914944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545667.147557:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454914944:12345-0@lo:400:kworker.0 Request processed in 90us (13270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545667.147564:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789545667.147589:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454914560 00000100:00100000:3.0:1789545667.147593:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454914560 00000100:00100000:3.0:1789545667.147916:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789545667.147924:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3312:x1876474454914560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545667.147961:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3312:x1876474454914560:12345-0@lo:400:kworker.0 Request processed in 39us (14371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545667.147967:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789545667.148665:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454914688:0@lo:400:kworker.0 00000100:00100000:0.0:1789545667.148678:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4eddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454915200:0@lo:400:kworker.0 00000100:00100000:0.0:1789545667.148713:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789545667.149461:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789545667.149496:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454914560:0@lo:400:kworker.0 00000100:00100000:0.0:1789545667.149693:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454915200 00000100:00100000:0.0:1789545667.149700:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454915200 00000100:00100000:0.0:1789545667.149756:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789545667.149765:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf6c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454915200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545667.149817:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf6c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454915200:12345-0@lo:400:kworker.0 Request processed in 54us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545667.149823:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1789545667.149858:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be4eddc00 x1876474454915200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545667.149870:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4eddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454915200:0@lo:400:kworker.0 00000100:00100000:1.0:1789545667.150529:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454914816 00000100:00100000:1.0:1789545667.150536:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454914816 00000100:00100000:1.0:1789545667.150565:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789545667.150572:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876474454914816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545667.150804:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876474454914816:12345-0@lo:400:kworker.0 Request processed in 231us (9014us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545667.150821:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789545667.150853:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876474454914816:0@lo:400:kworker.0 00000100:00080000:3.0:1789545667.150937:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789545667.150941:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789545667.151322:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be4eded80 x1876474454914944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545667.151333:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454914944:0@lo:400:kworker.0 00010000:00010000:3.0:1789545667.389534:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545667.645739:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454915328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789545667.645809:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545667.645880:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454915328 00000100:00100000:1.0:1789545667.645889:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454915328 00000100:00100000:1.0:1789545667.645935:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789545667.645944:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454915328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789545667.645977:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789545667.646031:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454915328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545667.646038:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789545667.646686:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789545667.646699:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454915456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789545667.646736:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545667.646799:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454915456 00000100:00100000:3.0:1789545667.646804:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454915456 00000100:00100000:3.0:1789545667.646835:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789545667.646841:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454915456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789545667.646864:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789545667.646902:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454915456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545667.646908:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1789545667.646947:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bdfb41f80 x1876474454915456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545683 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545667.646966:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454915456:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789545667.647407:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be4edfb80 x1876474454915328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545683 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545667.647432:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454915328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789545668.023987:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545668.025523:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545668.025556:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545668.025578:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545668.025608:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545668.025642:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438104064 00000100:00100000:1.0:1789545668.025651:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438104064 00000100:00100000:1.0:1789545668.025707:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438103936 00000100:00100000:1.0:1789545668.025711:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438103936 00000100:00100000:1.0:1789545668.025736:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 77 00000100:00100000:1.0:1789545668.025763:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2361:x1876474438104064:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545668.025839:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2361:x1876474438104064:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 80us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545668.025846:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 77 00000100:00100000:1.0:1789545668.025871:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 78 00000100:00100000:1.0:1789545668.025879:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+6:2361:x1876474438103936:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545668.025906:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+6:2361:x1876474438103936:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 28us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545668.025912:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 78 00000100:00100000:1.0:1789545668.025931:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438104320 00000100:00100000:1.0:1789545668.025935:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438104320 00000100:00100000:1.0:1789545668.025961:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438104192 00000100:00100000:1.0:1789545668.025964:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438104192 00000100:00100000:1.0:1789545668.025986:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 46 00000100:00100000:1.0:1789545668.025992:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2361:x1876474438104320:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545668.026511:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2361:x1876474438104320:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 518us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545668.026520:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 46 00000100:00100000:1.0:1789545668.026536:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 47 00000100:00100000:1.0:1789545668.026543:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2361:x1876474438104192:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545668.026568:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2361:x1876474438104192:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 26us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545668.026574:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 47 00000100:00080000:1.0:1789545668.026592:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789545668.026596:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789545668.026599:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789545668.028516:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438103808 00000100:00100000:2.0:1789545668.028528:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438103808 00000100:00100000:2.0:1789545668.028587:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 224 00000100:00100000:2.0:1789545668.028597:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2361:x1876474438103808:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545668.028663:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2361:x1876474438103808:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 66us (4688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545668.028670:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 224 00010000:00010000:0.0:1789545668.414099:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545669.436642:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545670.461424:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545671.484594:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545672.253795:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfc52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454915968:0@lo:400:kworker.0 00000100:00100000:2.0:1789545672.253860:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545672.253915:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789545672.253921:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfc50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454915584:0@lo:400:kworker.0 00000100:00100000:2.0:1789545672.253945:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545672.253964:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfc52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454916096:0@lo:400:kworker.0 00000100:00100000:2.0:1789545672.253983:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545672.254007:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454915584 00000100:00100000:2.0:1789545672.254014:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454915584 00000100:00100000:2.0:1789545672.254050:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789545672.254057:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454915584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545672.254098:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454915584:12345-0@lo:400:kworker.0 Request processed in 41us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545672.254110:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789545672.254151:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfc50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454915584:0@lo:400:kworker.0 00000100:00100000:1.0:1789545672.254389:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454915968 00000100:00100000:1.0:1789545672.254393:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454915968 00000100:00100000:1.0:1789545672.254431:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789545672.254438:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454915968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545672.254488:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454915968:12345-0@lo:400:kworker.0 Request processed in 50us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545672.254494:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789545672.254512:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454916096 00000100:00100000:1.0:1789545672.254515:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454916096 00000100:00100000:1.0:1789545672.254540:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789545672.254546:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454916096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545672.254574:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454916096:12345-0@lo:400:kworker.0 Request processed in 28us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545672.254580:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1789545672.254595:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789545672.254599:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789545672.254623:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfc52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454916096:0@lo:400:kworker.0 00010000:00080000:1.0:1789545672.254634:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bdfc52680 x1876474454915968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545672.254644:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfc52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454915968:0@lo:400:kworker.0 00000100:00100000:0.0:1789545672.255115:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfc51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454915712:0@lo:400:kworker.0 00000100:00100000:0.0:1789545672.255152:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545672.255223:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfc53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454916224:0@lo:400:kworker.0 00000100:00100000:0.0:1789545672.255247:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545672.255276:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789545672.255284:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfc52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454915840:0@lo:400:kworker.0 00000100:00100000:0.0:1789545672.255305:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545672.255347:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454916224 00000100:00100000:2.0:1789545672.255352:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454916224 00000100:00100000:2.0:1789545672.255419:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789545672.255427:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf6c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454916224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545672.255464:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf6c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454916224:12345-0@lo:400:kworker.0 Request processed in 38us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545672.255470:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1789545672.255525:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789545672.255881:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bdfc53800 x1876474454916224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545672.255892:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfc53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454916224:0@lo:400:kworker.0 00000100:00100000:1.0:1789545672.259495:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454915712 00000100:00100000:1.0:1789545672.259510:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454915712 00000100:00100000:3.0:1789545672.259758:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454915840 00000100:00100000:3.0:1789545672.259764:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454915840 00000100:00100000:3.0:1789545672.259825:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789545672.259835:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf6c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454915712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545672.259940:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf6c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454915712:12345-0@lo:400:kworker.0 Request processed in 106us (4787us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545672.259946:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789545672.259971:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789545672.259978:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf6c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454915840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545672.260010:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf6c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454915840:12345-0@lo:400:kworker.0 Request processed in 33us (4704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545672.260015:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789545672.260060:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfc52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454915840:0@lo:400:kworker.0 00000100:00100000:3.0:1789545672.260073:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfc51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454915712:0@lo:400:kworker.0 00000100:00080000:2.0:1789545672.260140:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789545672.508606:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789545672.764507:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789545672.764532:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454916352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789545672.764604:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545672.764646:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454916352 00000100:00100000:2.0:1789545672.764657:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454916352 00000100:00100000:2.0:1789545672.764710:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789545672.764721:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454916352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789545672.764765:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789545672.764829:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454916352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545672.764835:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1789545672.764929:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bdfb41f80 x1876474454916352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545688 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545672.764947:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454916352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789545672.765433:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454916480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789545672.770187:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545672.770753:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454916480 00000100:00100000:2.0:1789545672.770763:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454916480 00000100:00100000:2.0:1789545672.771087:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789545672.771098:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454916480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789545672.771140:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789545672.771220:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454916480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545672.771228:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1789545672.771403:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be4edc700 x1876474454916480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545688 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545672.771425:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454916480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789545673.150455:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545673.150488:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545673.150521:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545673.150547:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545673.150571:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545673.150598:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438104448 00000100:00100000:3.0:1789545673.150599:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438104832 00000100:00100000:3.0:1789545673.150607:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438104832 00000100:00100000:2.0:1789545673.150607:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438104448 00000100:00100000:2.0:1789545673.150651:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 226 00000100:00100000:3.0:1789545673.150655:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438104960 00000100:00100000:3.0:1789545673.150657:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438104960 00000100:00100000:2.0:1789545673.150661:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2360:x1876474438104448:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:3.0:1789545673.150677:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 14 00000100:00100000:3.0:1789545673.150682:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2357:x1876474438104832:12345-192.168.201.16@tcp:9:kworker.0 00000020:00000080:3.0:1789545673.150700:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c06b6 00000100:00080000:3.0:1789545673.150709:0:6691:0:(import.c:65:import_set_state_nolock()) ffff994be4c98800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789545673.150723:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2360:x1876474438104448:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 63us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545673.150730:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 226 00000001:00000004:3.0:1789545673.150754:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789545673.150759:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438104704 00000100:00100000:2.0:1789545673.150763:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438104704 00000100:00100000:2.0:1789545673.150786:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438104576 00000100:00100000:2.0:1789545673.150788:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438104576 00000100:00100000:2.0:1789545673.150808:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 82 00000100:00100000:2.0:1789545673.150813:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2360:x1876474438104704:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545673.150839:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2360:x1876474438104704:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 26us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545673.150844:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 82 00000100:00100000:2.0:1789545673.150856:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 83 00000100:00100000:2.0:1789545673.150861:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+6:2360:x1876474438104576:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545673.150879:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+6:2360:x1876474438104576:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 19us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545673.150885:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 83 00000100:00080000:2.0:1789545673.150914:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789545673.150918:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789545673.150920:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789545673.150934:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 15 00000100:00100000:2.0:1789545673.150940:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2357:x1876474438104960:12345-192.168.201.16@tcp:9:kworker.0 00000020:00000080:2.0:1789545673.150950:0:6692:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c06bd 00000100:00080000:2.0:1789545673.150955:0:6692:0:(import.c:65:import_set_state_nolock()) ffff994be4c99800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789545673.150975:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789545673.151064:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+2:2357:x1876474438104832:12345-192.168.201.16@tcp:9:kworker.0 Request processed in 380us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545673.151079:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 14 00000100:00100000:2.0:1789545673.151163:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:347985d0-1f2a-4d4d-ae4d-f363a612744e+2:2357:x1876474438104960:12345-192.168.201.16@tcp:9:kworker.0 Request processed in 222us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545673.151170:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 15 00010000:00010000:3.0:1789545673.152027:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545673.152375:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545673.539415:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545674.560953:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545675.582183:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789545676.057814:0:11033:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789545676.605176:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789545676.915121:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 347985d0-1f2a-4d4d-ae4d-f363a612744e 00000020:00000080:3.0:1789545676.915129:0:6717:0:(genops.c:885:class_export_put()) final put ffff994be4c9e000/347985d0-1f2a-4d4d-ae4d-f363a612744e 00000020:00000080:0.0:1789545676.915218:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff994be4c9e000/347985d0-1f2a-4d4d-ae4d-f363a612744e for lustre-OST0000 00000020:00000080:0.0:1789545676.915340:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff994be4c98800 for lustre-OST0000 00000100:00100000:2.0:1789545677.372715:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfc51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454916608:0@lo:400:kworker.0 00000100:00100000:2.0:1789545677.372789:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545677.372844:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfc52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454917120:0@lo:400:kworker.0 00000100:00100000:2.0:1789545677.372873:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545677.372899:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789545677.372906:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfc52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454916992:0@lo:400:kworker.0 00000100:00100000:2.0:1789545677.372930:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545677.372962:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfc52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454916736:0@lo:400:kworker.0 00000100:00100000:2.0:1789545677.372984:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545677.373002:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfc53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454917248:0@lo:400:kworker.0 00000100:00100000:2.0:1789545677.373021:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545677.373039:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789545677.373055:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfc53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454916864:0@lo:400:kworker.0 00000100:00100000:2.0:1789545677.373079:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545677.373111:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454916608 00000100:00100000:2.0:1789545677.373118:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454916608 00000100:00100000:2.0:1789545677.373161:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789545677.373169:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3312:x1876474454916608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545677.373210:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3312:x1876474454916608:12345-0@lo:400:kworker.0 Request processed in 42us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545677.373217:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789545677.373258:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454917120 00000100:00100000:2.0:1789545677.373262:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454917120 00000100:00100000:2.0:1789545677.373294:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454916736 00000100:00100000:2.0:1789545677.373297:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454916736 00000100:00100000:2.0:1789545677.373309:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454916864 00000100:00100000:2.0:1789545677.373311:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454916864 00000100:00100000:2.0:1789545677.373324:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789545677.373330:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc641d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454917120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545677.373381:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc641d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454917120:12345-0@lo:400:kworker.0 Request processed in 51us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545677.373387:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789545677.373401:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789545677.373407:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc641ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454916736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545677.373439:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc641ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454916736:12345-0@lo:400:kworker.0 Request processed in 32us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545677.373445:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789545677.373469:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789545677.373475:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454916864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545677.373513:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454916864:12345-0@lo:400:kworker.0 Request processed in 39us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545677.373519:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789545677.373540:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454916992 00000100:00100000:2.0:1789545677.373544:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454916992 00000100:00100000:2.0:1789545677.373568:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454917248 00000100:00100000:2.0:1789545677.373571:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454917248 00000100:00100000:2.0:1789545677.373588:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789545677.373593:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc641f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454916992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545677.373621:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc641f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454916992:12345-0@lo:400:kworker.0 Request processed in 27us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545677.373626:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789545677.373636:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789545677.373642:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc641ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454917248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545677.373668:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc641ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454917248:12345-0@lo:400:kworker.0 Request processed in 27us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545677.373674:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1789545677.373700:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789545677.373703:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789545677.373706:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789545677.373741:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfc53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454916864:0@lo:400:kworker.0 00000100:00100000:2.0:1789545677.373752:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfc52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454916736:0@lo:400:kworker.0 00010000:00080000:2.0:1789545677.373763:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bdfc53100 x1876474454917248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545677.373773:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfc53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454917248:0@lo:400:kworker.0 00010000:00080000:2.0:1789545677.373819:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bdfc52680 x1876474454916992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545677.373827:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfc52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454916992:0@lo:400:kworker.0 00000100:00100000:2.0:1789545677.373835:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfc51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454916608:0@lo:400:kworker.0 00000100:00100000:2.0:1789545677.373843:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfc52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454917120:0@lo:400:kworker.0 00000001:00100000:1.0:1789545677.434856:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 347985d0-1f2a-4d4d-ae4d-f363a612744e 00000020:00000080:1.0:1789545677.434865:0:7650:0:(genops.c:885:class_export_put()) final put ffff994be4c9f000/347985d0-1f2a-4d4d-ae4d-f363a612744e 00000020:00000080:1.0:1789545677.434892:0:1469:0:(genops.c:844:class_export_destroy()) destroying export ffff994be4c9f000/347985d0-1f2a-4d4d-ae4d-f363a612744e for lustre-OST0001 00000020:00000080:1.0:1789545677.434937:0:1469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff994be4c99800 for lustre-OST0001 00010000:00010000:2.0:1789545677.628857:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545677.885347:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf6c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454917376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789545677.885447:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545677.885578:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454917376 00000100:00100000:0.0:1789545677.885587:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454917376 00000100:00100000:0.0:1789545677.885638:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789545677.885648:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454917376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789545677.885684:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789545677.885733:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454917376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545677.885740:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789545677.886466:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454917504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789545677.886515:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545677.886692:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454917504 00000100:00100000:3.0:1789545677.886698:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454917504 00000100:00100000:3.0:1789545677.886724:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789545677.886730:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454917504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789545677.886768:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789545677.886809:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454917504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545677.886816:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1789545677.886942:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bdfb41f80 x1876474454917504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545693 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1789545677.886942:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bdf6c0000 x1876474454917376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545693 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545677.886961:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454917504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789545677.886961:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf6c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454917376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789545678.264119:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545678.264171:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545678.264210:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545678.264269:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438105216 00000100:00100000:0.0:1789545678.264278:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438105216 00000100:00100000:0.0:1789545678.264333:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438105344 00000100:00100000:0.0:1789545678.264336:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438105344 00000100:00100000:0.0:1789545678.264404:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 87 00000100:00100000:0.0:1789545678.264415:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf6c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+6:2358:x1876474438105216:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:0.0:1789545678.264497:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf6c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+6:2358:x1876474438105216:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 84us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545678.264505:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 87 00000100:00100000:0.0:1789545678.264521:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 88 00000100:00100000:0.0:1789545678.264528:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf6c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2358:x1876474438105344:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:0.0:1789545678.264548:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf6c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2358:x1876474438105344:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 21us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545678.264554:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 88 00000100:00080000:0.0:1789545678.264567:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789545678.265422:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438105088 00000100:00100000:3.0:1789545678.265441:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438105088 00000100:00100000:3.0:1789545678.265528:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 228 00000100:00100000:3.0:1789545678.265537:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2358:x1876474438105088:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:3.0:1789545678.265591:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2358:x1876474438105088:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 55us (1418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545678.265611:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 228 00010000:00010000:3.0:1789545678.656886:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545679.680534:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789545679.796005:0:11186:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff2f024450 20000000:00000080:3.0:1789545679.796023:0:11186:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff994bdf494c00 uarg=0000000000000000 20000000:01000000:3.0:1789545679.796057:0:11186:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789545679.796063:0:11186:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789545679.796067:0:11186:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789545679.796969:0:11187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1789545679.797120:0:11186:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789545679.802209:0:11186:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789545679.802299:0:11186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff994bc0031800/0x64919c0f856c06c4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545679.802322:0:11186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994c0217e200/0x64919c0f856c0669 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de535b expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545679.802332:0:11186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bc49d1c00/0x64919c0f856c0677 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0670 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545679.802339:0:11186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bc49d1200/0x64919c0f856c0685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c067e expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545679.802345:0:11186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bc49d1e00/0x64919c0f856c0693 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c068c expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545679.802389:0:11186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994c0217e400/0x64919c0f856c06a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5393 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545679.802398:0:11186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff994bc0031800/0x64919c0f856c06c4 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545679.802443:0:11186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994c0217e400/0x64919c0f856c06a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5393 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545679.802459:0:11186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994c0217e400/0x64919c0f856c06a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5393 expref: 12 pid: 5838 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545679.802474:0:11186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11186:1876474454917632:192.168.201.16@tcp:104: 00010000:00010000:0.0:1789545679.802573:0:11186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bc49d1e00/0x64919c0f856c0693 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c068c expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545679.802581:0:11186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994bc49d1e00/0x64919c0f856c0693 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c068c expref: 18 pid: 5838 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545679.802591:0:11186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11186:1876474454917760:0@lo:104: 00000100:00100000:0.0:1789545679.802629:0:11186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789545679.802667:0:11186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bc49d1200/0x64919c0f856c0685 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c067e expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545679.802675:0:11186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994bc49d1200/0x64919c0f856c0685 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c067e expref: 18 pid: 5838 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545679.802682:0:11186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11186:1876474454917888:0@lo:104: 00000100:00100000:0.0:1789545679.802712:0:11186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789545679.802735:0:11186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bc49d1c00/0x64919c0f856c0677 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c0670 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545679.802743:0:11186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994bc49d1c00/0x64919c0f856c0677 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c0670 expref: 18 pid: 5839 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545679.802751:0:11186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11186:1876474454918016:0@lo:104: 00000100:00100000:0.0:1789545679.802771:0:11186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789545679.802792:0:11186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994c0217e200/0x64919c0f856c0669 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de535b expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545679.802801:0:11186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994c0217e200/0x64919c0f856c0669 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de535b expref: 12 pid: 5838 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545679.802809:0:11186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11186:1876474454918144:192.168.201.16@tcp:104: 00000100:00100000:0.0:1789545679.802831:0:11186:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc8bab180 going to sleep for 11 seconds 00000100:00100000:0.0:1789545679.802866:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454917760 00000100:00100000:0.0:1789545679.802873:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454917760 00000100:00100000:0.0:1789545679.802912:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454917888 00000100:00100000:0.0:1789545679.802916:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454917888 00000100:00100000:0.0:1789545679.802928:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454918016 00000100:00100000:0.0:1789545679.802931:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454918016 00000100:00100000:0.0:1789545679.802944:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789545679.802953:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+5:11186:x1876474454917760:12345-0@lo:104: 00010000:00010000:0.0:1789545679.802966:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994bc49d0c00/0x64919c0f856c068c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c0693 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545679.803018:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789545679.803023:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+5:11186:x1876474454917760:12345-0@lo:104: Request processed in 72us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545679.803036:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789545679.803055:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789545679.803061:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+4:11186:x1876474454917888:12345-0@lo:104: 00010000:00010000:0.0:1789545679.803068:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994bc0031000/0x64919c0f856c067e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c0685 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545679.803101:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789545679.803106:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+4:11186:x1876474454917888:12345-0@lo:104: Request processed in 46us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545679.803111:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789545679.803124:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789545679.803130:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+3:11186:x1876474454918016:12345-0@lo:104: 00010000:00010000:0.0:1789545679.803137:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994c0217fa00/0x64919c0f856c0670 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c0677 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545679.803166:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789545679.803172:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+3:11186:x1876474454918016:12345-0@lo:104: Request processed in 42us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545679.803177:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789545679.803225:0:11186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11186:1876474454917760:0@lo:104: 00000100:00100000:0.0:1789545679.803234:0:11186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11186:1876474454917888:0@lo:104: 00000100:00100000:0.0:1789545679.803241:0:11186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11186:1876474454918016:0@lo:104: 00010000:00010000:3.0:1789545679.803499:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789545679.803506:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bc49d0c00/0x64919c0f856c068c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c0693 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.803514:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0c00 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:3.0:1789545679.803518:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bc49d0c00/0x64919c0f856c068c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c0693 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.803527:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bc49d0c00/0x64919c0f856c068c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c0693 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789545679.803535:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bc49d0c00/0x64919c0f856c068c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c0693 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789545679.803541:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789545679.803569:0:8453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bc49d0c00/0x64919c0f856c068c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0693 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.803576:0:8453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789545679.803602:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bc49d0c00/0x64919c0f856c068c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0693 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.803610:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bc49d0c00/0x64919c0f856c068c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0693 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.803623:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789545679.803627:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bc0031000/0x64919c0f856c067e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c0685 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.803633:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc0031000 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:3.0:1789545679.803635:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bc0031000/0x64919c0f856c067e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c0685 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.803642:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bc0031000/0x64919c0f856c067e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c0685 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789545679.803648:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bc0031000/0x64919c0f856c067e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c0685 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789545679.803654:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789545679.803669:0:8453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bc0031000/0x64919c0f856c067e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0685 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.803684:0:8453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789545679.803699:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bc0031000/0x64919c0f856c067e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0685 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.803706:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bc0031000/0x64919c0f856c067e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0685 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.803716:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789545679.803725:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994c0217fa00/0x64919c0f856c0670 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c0677 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.803731:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217fa00 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:3.0:1789545679.803734:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994c0217fa00/0x64919c0f856c0670 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c0677 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.803741:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994c0217fa00/0x64919c0f856c0670 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c0677 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789545679.803748:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994c0217fa00/0x64919c0f856c0670 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c0677 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789545679.803753:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789545679.803767:0:8453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994c0217fa00/0x64919c0f856c0670 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0677 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.803774:0:8453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789545679.803786:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994c0217fa00/0x64919c0f856c0670 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0677 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.803793:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994c0217fa00/0x64919c0f856c0670 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c0677 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.803808:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545679.803810:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545679.803812:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545679.803819:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789545679.803832:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454918272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789545679.803865:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545679.803913:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454918272 00000100:00100000:3.0:1789545679.803923:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454918272 00010000:00010000:3.0:1789545679.803942:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bc49d1e00/0x64919c0f856c0693 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c068c expref: 19 pid: 5838 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545679.803965:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789545679.803972:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd9365050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3312:x1876474454918272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789545679.803982:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545679.803987:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bc49d1e00/0x64919c0f856c0693 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c068c expref: 19 pid: 5838 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.803997:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bc49d1e00/0x64919c0f856c0693 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c068c expref: 19 pid: 5838 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.804010:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc49d1e00/0x64919c0f856c0693 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c068c expref: 19 pid: 5838 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.804020:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545679.804050:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd9365050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:3312:x1876474454918272:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545679.804056:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789545679.804111:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454918272:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789545679.808024:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545679.808053:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beb86ab1-4563-44b1-afd1-f08a43b0622e:3313:1876474454918400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789545679.808513:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545679.808621:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789545679.808629:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beb86ab1-4563-44b1-afd1-f08a43b0622e:3313:1876474454918528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789545679.808654:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545679.811802:0:11186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11186:1876474454917632:192.168.201.16@tcp:104: 00000100:00100000:2.0:1789545679.815463:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545679.816083:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454918528 00000100:00100000:0.0:1789545679.816083:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454918400 00000100:00100000:0.0:1789545679.816093:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454918400 00000100:00100000:3.0:1789545679.816094:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454918528 00010000:00010000:3.0:1789545679.816144:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bc49d1c00/0x64919c0f856c0677 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c0670 expref: 19 pid: 5839 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545679.816144:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bc49d1200/0x64919c0f856c0685 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c067e expref: 19 pid: 5838 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545679.816218:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789545679.816228:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3313:x1876474454918400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789545679.816243:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789545679.816250:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bc49d1200/0x64919c0f856c0685 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c067e expref: 19 pid: 5838 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545679.816261:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bc49d1200/0x64919c0f856c0685 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c067e expref: 19 pid: 5838 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545679.816278:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc49d1200/0x64919c0f856c0685 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c067e expref: 19 pid: 5838 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545679.816294:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789545679.816379:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:3313:x1876474454918400:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (7867us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545679.816386:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789545679.816450:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789545679.816461:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:3313:x1876474454918528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789545679.816478:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545679.816483:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bc49d1c00/0x64919c0f856c0677 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c0670 expref: 17 pid: 5839 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.816491:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bc49d1c00/0x64919c0f856c0677 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c0670 expref: 17 pid: 5839 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.816502:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc49d1c00/0x64919c0f856c0677 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c0670 expref: 17 pid: 5839 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.816512:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545679.816551:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:3313:x1876474454918528:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (7896us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545679.816557:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789545679.818514:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438105472 00000100:00100000:3.0:1789545679.818527:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438105472 00010000:00010000:3.0:1789545679.818564:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994c0217e400/0x64919c0f856c06a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5393 expref: 13 pid: 5838 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545679.818595:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 28 00000100:00100000:3.0:1789545679.818606:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2358:x1876474438105472:12345-192.168.201.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789545679.818617:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:3.0:1789545679.818621:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545679.818628:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994c0217e400/0x64919c0f856c06a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5393 expref: 13 pid: 5838 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.818643:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994c0217e400/0x64919c0f856c06a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5393 expref: 13 pid: 5838 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.818661:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994c0217e400/0x64919c0f856c06a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5393 expref: 13 pid: 5838 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.818688:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789545679.818715:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438105600 00000100:00100000:0.0:1789545679.818721:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438105600 00000100:00100000:3.0:1789545679.818737:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2358:x1876474438105472:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 132us (3280us total) trans 0 rc 0/0 00010000:00010000:0.0:1789545679.818743:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994c0217e200/0x64919c0f856c0669 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de535b expref: 13 pid: 5838 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545679.818750:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 28 00000100:00100000:3.0:1789545679.818775:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 29 00000100:00100000:3.0:1789545679.818791:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7941446-3286-4db8-8c2a-05ec7eed2433+12:2358:x1876474438105600:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789545679.818799:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545679.818804:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994c0217e200/0x64919c0f856c0669 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de535b expref: 12 pid: 5838 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.818814:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994c0217e200/0x64919c0f856c0669 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de535b expref: 12 pid: 5838 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.818827:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff994bc0031800/0x64919c0f856c06c4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.818837:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc0031800/0x64919c0f856c06c4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545679.818839:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beb86ab1-4563-44b1-afd1-f08a43b0622e:3313:1876474454918528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789545679.818857:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beb86ab1-4563-44b1-afd1-f08a43b0622e:3313:1876474454918400:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789545679.818860:0:7636:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994bc0031800/0x64919c0f856c06c4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.818869:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994bc0031800/0x64919c0f856c06c4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.818876:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff994bc0031800/0x64919c0f856c06c4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.818882:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff994bc0031800/0x64919c0f856c06c4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.818895:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc0031800 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545679.818899:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff994bc0031800/0x64919c0f856c06c4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.818906:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff994bc0031800/0x64919c0f856c06c4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.818915:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff994bc0031800/0x64919c0f856c06c4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545679.818925:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545679.818945:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7941446-3286-4db8-8c2a-05ec7eed2433+12:2358:x1876474438105600:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 156us (331us total) trans 0 rc 0/0 00010000:00010000:2.0:1789545679.820026:0:11186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994c0217e200/0x64919c0f856c0669 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de535b expref: 12 pid: 5838 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545679.820051:0:11186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11186:1876474454918144:192.168.201.16@tcp:104: 00010000:00010000:2.0:1789545679.820085:0:11186:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff994bc0031800/0x64919c0f856c06c4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545679.820094:0:11186:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff994bc0031800/0x64919c0f856c06c4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545679.820099:0:11186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff994bc0031800/0x64919c0f856c06c4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545679.820105:0:11186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc0031800/0x64919c0f856c06c4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545679.825888:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 29 00010000:00010000:2.0:1789545680.710967:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789545680.956857:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789545680.956865:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994bdfb06800 from 7 10000000:01000000:1.0:1789545680.956878:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789545680.957005:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9800/0x64919c0f856c06cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545680.957018:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9800/0x64919c0f856c06cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545680.957030:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9800/0x64919c0f856c06cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545680.957058:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454918656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789545680.957125:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545680.957192:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994ac2b53540 going to sleep for 11 seconds 00000100:00100000:2.0:1789545680.957397:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454918656 00000100:00100000:2.0:1789545680.957406:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454918656 00000100:00100000:2.0:1789545680.957458:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789545680.957468:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:5843:x1876474454918656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789545680.957483:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545680.957497:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc49d0a00/0x64919c0f856c06d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c06cb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545680.957521:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc49d0a00/0x64919c0f856c06d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c06cb expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545680.957532:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc49d0a00/0x64919c0f856c06d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c06cb expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545680.957541:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0a00, rc 0) 00000100:00100000:2.0:1789545680.957599:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:5843:x1876474454918656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545680.957606:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789545680.958045:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454918656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789545680.958064:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9800/0x64919c0f856c06cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c06d2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545680.958074:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9800/0x64919c0f856c06cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c06d2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545680.958133:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454918784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789545680.958168:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545680.958195:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994ac2b53540 going to sleep for 11 seconds 00000100:00100000:0.0:1789545680.958257:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454918784 00000100:00100000:0.0:1789545680.958263:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454918784 00000100:00100000:0.0:1789545680.958299:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789545680.958308:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:5843:x1876474454918784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789545680.958579:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:5843:x1876474454918784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 271us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545680.958595:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789545680.959176:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454918784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789545680.959228:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454918912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789545680.959276:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545680.959312:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994ac2b53540 going to sleep for 11 seconds 00000100:00100000:3.0:1789545680.960156:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454918912 00000100:00100000:3.0:1789545680.960163:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454918912 00000100:00100000:3.0:1789545680.960221:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789545680.960230:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:5843:x1876474454918912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789545680.960436:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:5843:x1876474454918912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545680.960444:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789545680.960742:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454918912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789545680.961692:0:11211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789545680.961912:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789545680.961931:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789545680.961943:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9800/0x64919c0f856c06cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c06d2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545680.961954:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9800/0x64919c0f856c06cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c06d2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789545680.961974:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789545680.961977:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994bc8231800 from 7 10000000:01000000:3.0:1789545680.961980:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789545680.962011:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994c0217e400/0x64919c0f856c06d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545680.962020:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994c0217e400/0x64919c0f856c06d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545680.962029:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994c0217e400/0x64919c0f856c06d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545680.962053:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454919040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789545680.962102:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545680.962153:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994be4c27780 going to sleep for 11 seconds 00000100:00100000:1.0:1789545680.962264:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454919040 00000100:00100000:1.0:1789545680.962272:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454919040 00000100:00100000:1.0:1789545680.962314:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789545680.962322:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:5843:x1876474454919040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789545680.962334:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545680.962346:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc8ba9400/0x64919c0f856c06e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c06d9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545680.962390:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc8ba9400/0x64919c0f856c06e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c06d9 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545680.962401:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc8ba9400/0x64919c0f856c06e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c06d9 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545680.962409:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba9400, rc 0) 00000100:00100000:1.0:1789545680.962452:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:5843:x1876474454919040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545680.962459:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789545680.962517:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454919040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789545680.962532:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994c0217e400/0x64919c0f856c06d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c06e0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545680.962541:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994c0217e400/0x64919c0f856c06d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c06e0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545680.962588:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454919168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789545680.962626:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545680.962641:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994ac2b53cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789545680.962729:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454919168 00000100:00100000:1.0:1789545680.962734:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454919168 00000100:00100000:1.0:1789545680.962758:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789545680.962841:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:5843:x1876474454919168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789545680.963152:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:5843:x1876474454919168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 387us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545680.963161:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789545680.963206:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454919168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789545680.963236:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454919296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789545680.963273:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545680.963287:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994ac2b53cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789545680.963299:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454919296 00000100:00100000:1.0:1789545680.963302:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454919296 00000100:00100000:1.0:1789545680.963324:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789545680.963330:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:5843:x1876474454919296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789545680.963484:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:5843:x1876474454919296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545680.963491:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789545680.963529:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454919296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789545680.964749:0:11212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789545680.964941:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789545680.964963:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789545680.964974:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994c0217e400/0x64919c0f856c06d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c06e0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545680.964985:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994c0217e400/0x64919c0f856c06d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c06e0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789545680.964996:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789545680.964999:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994bc4a49800 from 7 10000000:01000000:3.0:1789545680.965002:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789545680.965035:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994c0217fa00/0x64919c0f856c06e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545680.965043:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994c0217fa00/0x64919c0f856c06e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545680.965062:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994c0217fa00/0x64919c0f856c06e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545680.965084:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454919424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789545680.965140:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545680.965199:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994be4c27d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789545680.965311:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454919424 00000100:00100000:1.0:1789545680.965319:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454919424 00000100:00100000:1.0:1789545680.965387:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789545680.965398:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:5843:x1876474454919424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789545680.965416:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545680.965429:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc8ba9e00/0x64919c0f856c06ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c06e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545680.965451:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc8ba9e00/0x64919c0f856c06ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c06e7 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545680.965461:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc8ba9e00/0x64919c0f856c06ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c06e7 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545680.965469:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba9e00, rc 0) 00000100:00100000:1.0:1789545680.965505:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:5843:x1876474454919424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545680.965511:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789545680.965663:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454919424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789545680.965678:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994c0217fa00/0x64919c0f856c06e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c06ee expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545680.965687:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994c0217fa00/0x64919c0f856c06e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c06ee expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545680.965737:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454919552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789545680.965775:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545680.965796:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994be4c27d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789545680.965873:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454919552 00000100:00100000:1.0:1789545680.965878:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454919552 00000100:00100000:1.0:1789545680.965916:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789545680.965922:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:5843:x1876474454919552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789545680.966154:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:5843:x1876474454919552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545680.966162:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789545680.966294:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454919552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789545680.966325:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454919680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789545680.966392:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545680.966410:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994be4c27d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789545680.966461:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454919680 00000100:00100000:1.0:1789545680.966466:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454919680 00000100:00100000:1.0:1789545680.966494:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789545680.966501:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:5843:x1876474454919680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789545680.966633:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:5843:x1876474454919680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545680.966649:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789545680.966715:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454919680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789545680.968170:0:11213:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789545680.968641:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789545680.968665:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789545680.968677:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994c0217fa00/0x64919c0f856c06e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c06ee expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545680.968689:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994c0217fa00/0x64919c0f856c06e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c06ee expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545681.651182:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545681.651272:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438105728 00000100:00100000:3.0:1789545681.651285:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438105728 00000100:00100000:3.0:1789545681.651354:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 238 00000100:00100000:3.0:1789545681.651389:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+11:5596:x1876474438105728:12345-192.168.201.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789545681.651408:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545681.651427:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994c0217f600/0x64919c0f856c06f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de53bd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545681.651465:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994c0217f600/0x64919c0f856c06f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53bd expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545681.651478:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994c0217f600/0x64919c0f856c06f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53bd expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545681.651642:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217f600, rc 0) 00000100:00100000:3.0:1789545681.651707:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+12:5596:x1876474438105728:12345-192.168.201.16@tcp:101:ll_cfg_requeue.0 Request processed in 321us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545681.651716:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 238 00000100:00100000:3.0:1789545681.653423:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545681.653529:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438105856 00000100:00100000:1.0:1789545681.653539:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438105856 00000100:00100000:1.0:1789545681.653587:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 239 00000100:00100000:1.0:1789545681.653597:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+12:5596:x1876474438105856:12345-192.168.201.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789545681.654084:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+12:5596:x1876474438105856:12345-192.168.201.16@tcp:501:ll_cfg_requeue.0 Request processed in 487us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545681.654093:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 239 00000100:00100000:2.0:1789545681.660929:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545681.660982:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438105984 00000100:00100000:2.0:1789545681.660993:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438105984 00000100:00100000:2.0:1789545681.661043:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 240 00000100:00100000:2.0:1789545681.661052:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+12:5596:x1876474438105984:12345-192.168.201.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789545681.661286:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+12:5596:x1876474438105984:12345-192.168.201.16@tcp:503:ll_cfg_requeue.0 Request processed in 234us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545681.661295:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 240 00000100:00100000:2.0:1789545681.672702:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545681.674695:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438106112 00000100:00100000:1.0:1789545681.674712:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438106112 00000100:00100000:1.0:1789545681.674792:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 241 00000100:00100000:1.0:1789545681.674803:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+12:5596:x1876474438106112:12345-192.168.201.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789545681.674821:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545681.674839:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc8ba9000/0x64919c0f856c06fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de53c4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545681.674866:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc8ba9000/0x64919c0f856c06fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53c4 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545681.674894:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc8ba9000/0x64919c0f856c06fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53c4 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545681.674905:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba9000, rc 0) 00000100:00100000:1.0:1789545681.675696:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+13:5596:x1876474438106112:12345-192.168.201.16@tcp:101:ll_cfg_requeue.0 Request processed in 891us (3000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545681.675706:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 241 00000100:00100000:3.0:1789545681.677517:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545681.678028:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438106240 00000100:00100000:1.0:1789545681.678040:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438106240 00000100:00100000:1.0:1789545681.678101:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 242 00000100:00100000:1.0:1789545681.678111:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+13:5596:x1876474438106240:12345-192.168.201.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789545681.678426:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+13:5596:x1876474438106240:12345-192.168.201.16@tcp:501:ll_cfg_requeue.0 Request processed in 315us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545681.678436:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 242 00000100:00100000:1.0:1789545681.703147:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545681.703247:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438106368 00000100:00100000:3.0:1789545681.703259:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438106368 00000100:00100000:3.0:1789545681.703313:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 243 00000100:00100000:3.0:1789545681.703323:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+13:5596:x1876474438106368:12345-192.168.201.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789545681.703571:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+13:5596:x1876474438106368:12345-192.168.201.16@tcp:503:ll_cfg_requeue.0 Request processed in 248us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545681.703580:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 243 00010000:00010000:0.0:1789545681.724980:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545682.499685:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454919808:0@lo:400:kworker.0 00000100:00100000:0.0:1789545682.499767:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545682.499816:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789545682.499821:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454919936:0@lo:400:kworker.0 00000100:00100000:0.0:1789545682.499884:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545682.499916:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454919808 00000100:00100000:0.0:1789545682.499923:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454919808 00000100:00100000:0.0:1789545682.499967:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789545682.500097:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454919808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545682.500147:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454919808:12345-0@lo:400:kworker.0 Request processed in 171us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545682.500165:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789545682.500194:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454919936 00000100:00100000:0.0:1789545682.500197:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454919936 00000100:00100000:0.0:1789545682.500218:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789545682.500224:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454919936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545682.500250:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454919936:12345-0@lo:400:kworker.0 Request processed in 26us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545682.500255:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789545682.500288:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454919936:0@lo:400:kworker.0 00000100:00100000:0.0:1789545682.500297:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454919808:0@lo:400:kworker.0 00000100:00100000:3.0:1789545682.500353:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454920064:0@lo:400:kworker.0 00000100:00100000:3.0:1789545682.500412:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545682.500479:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454920192:0@lo:400:kworker.0 00000100:00100000:3.0:1789545682.500504:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545682.500537:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454920192 00000100:00100000:3.0:1789545682.500541:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454920192 00000100:00100000:3.0:1789545682.500576:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789545682.500582:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454920192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545682.500685:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454920192:12345-0@lo:400:kworker.0 Request processed in 102us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545682.500692:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1789545682.500778:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bdfb43100 x1876474454920192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545682.500790:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454920192:0@lo:400:kworker.0 00000100:00100000:1.0:1789545682.500948:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454920448:0@lo:400:kworker.0 00000100:00100000:1.0:1789545682.500975:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545682.501067:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789545682.501073:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454920320:0@lo:400:kworker.0 00000100:00100000:1.0:1789545682.501095:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545682.501120:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454920064 00000100:00100000:1.0:1789545682.501124:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454920064 00000100:00100000:1.0:1789545682.501145:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454920320 00000100:00100000:1.0:1789545682.501147:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454920320 00000100:00100000:1.0:1789545682.501175:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789545682.501181:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454920064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545682.501218:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454920064:12345-0@lo:400:kworker.0 Request processed in 38us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545682.501224:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789545682.501237:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789545682.501242:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454920320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545682.501268:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454920320:12345-0@lo:400:kworker.0 Request processed in 26us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545682.501274:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789545682.501293:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454920320:0@lo:400:kworker.0 00000100:00100000:3.0:1789545682.501442:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454920064:0@lo:400:kworker.0 00000100:00100000:3.0:1789545682.501469:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454920448 00000100:00100000:3.0:1789545682.501471:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454920448 00000100:00100000:3.0:1789545682.501493:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789545682.501499:0:8211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454920448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545682.501535:0:8211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454920448:12345-0@lo:400:kworker.0 Request processed in 36us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545682.501540:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1789545682.501567:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bdfb41f80 x1876474454920448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545682.501577:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454920448:0@lo:400:kworker.0 00000100:00080000:0.0:1789545682.502806:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789545682.502814:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789545682.502825:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789545682.748609:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545683.004804:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454920576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789545683.004878:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545683.004961:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454920576 00000100:00100000:2.0:1789545683.004970:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454920576 00000100:00100000:2.0:1789545683.005009:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789545683.005017:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454920576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789545683.005049:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789545683.005092:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454920576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545683.005099:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1789545683.005136:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be54d0e00 x1876474454920576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545699 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545683.005165:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454920576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789545683.006258:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454920704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789545683.006297:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545683.007764:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454920704 00000100:00100000:0.0:1789545683.007776:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454920704 00000100:00100000:0.0:1789545683.007817:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789545683.007826:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454920704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789545683.007856:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789545683.007913:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454920704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (1615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545683.007919:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1789545683.008229:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be54c4a80 x1876474454920704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545699 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545683.008249:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454920704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789545683.378512:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545683.378569:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545683.378603:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545683.378654:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438106496 00000100:00100000:1.0:1789545683.378667:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438106496 00000100:00100000:1.0:1789545683.378854:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 245 00000100:00100000:1.0:1789545683.378869:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2361:x1876474438106496:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545683.378983:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2361:x1876474438106496:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 117us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545683.378992:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 245 00000100:00100000:1.0:1789545683.379049:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438106752 00000100:00100000:1.0:1789545683.379054:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438106752 00000100:00100000:1.0:1789545683.379106:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438106624 00000100:00100000:1.0:1789545683.379111:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438106624 00000100:00100000:1.0:1789545683.379228:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 92 00000100:00100000:1.0:1789545683.379236:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2361:x1876474438106752:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545683.379292:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2361:x1876474438106752:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 56us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545683.379299:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 92 00000100:00100000:1.0:1789545683.379315:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 93 00000100:00100000:1.0:1789545683.379322:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+6:2361:x1876474438106624:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545683.379352:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+6:2361:x1876474438106624:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 30us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545683.379392:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 93 00000100:00080000:1.0:1789545683.379896:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789545683.773664:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789545684.064007:0:11384:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg116-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789545684.796740:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545685.829056:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545686.844616:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789545687.612596:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876474454920960:0@lo:400:kworker.0 00000100:00100000:3.0:1789545687.612655:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545687.612713:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454921472:0@lo:400:kworker.0 00000100:00100000:3.0:1789545687.612756:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545687.612804:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789545687.612809:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454920832:0@lo:400:kworker.0 00000100:00100000:3.0:1789545687.612841:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545687.612863:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454921344:0@lo:400:kworker.0 00000100:00100000:3.0:1789545687.612882:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545687.612907:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454921088:0@lo:400:kworker.0 00000100:00100000:3.0:1789545687.612933:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545687.612954:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789545687.612960:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454921216:0@lo:400:kworker.0 00000100:00100000:3.0:1789545687.612984:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545687.613030:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454920960 00000100:00100000:3.0:1789545687.613039:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454920960 00000100:00100000:3.0:1789545687.613088:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454921344 00000100:00100000:3.0:1789545687.613092:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454921344 00000100:00100000:3.0:1789545687.613114:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454921088 00000100:00100000:3.0:1789545687.613117:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454921088 00000100:00100000:3.0:1789545687.613133:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789545687.613143:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876474454920960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545687.613176:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454921472 00000100:00100000:0.0:1789545687.613182:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454921472 00000100:00100000:3.0:1789545687.613201:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876474454920960:12345-0@lo:400:kworker.0 Request processed in 59us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545687.613209:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789545687.613215:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454921216 00000100:00100000:0.0:1789545687.613219:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454921216 00000100:00100000:3.0:1789545687.613232:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789545687.613242:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454921344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545687.613246:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789545687.613260:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454921472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545687.613280:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454921344:12345-0@lo:400:kworker.0 Request processed in 39us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545687.613297:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789545687.613310:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454921472:12345-0@lo:400:kworker.0 Request processed in 52us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545687.613316:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789545687.613323:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789545687.613328:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454921088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545687.613345:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789545687.613376:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454921216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545687.613396:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454921088:12345-0@lo:400:kworker.0 Request processed in 71us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545687.613403:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789545687.613431:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454920832 00000100:00100000:0.0:1789545687.613433:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454921216:12345-0@lo:400:kworker.0 Request processed in 79us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545687.613436:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454920832 00000100:00100000:0.0:1789545687.613444:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789545687.613469:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789545687.613479:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3312:x1876474454920832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545687.613516:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3312:x1876474454920832:12345-0@lo:400:kworker.0 Request processed in 41us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545687.613523:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:3.0:1789545687.613560:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789545687.613563:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789545687.613566:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789545687.613600:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bdfb40e00 x1876474454921216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545687.613615:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454921216:0@lo:400:kworker.0 00000100:00100000:3.0:1789545687.613628:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454921088:0@lo:400:kworker.0 00000100:00100000:3.0:1789545687.613659:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454920832:0@lo:400:kworker.0 00000100:00100000:3.0:1789545687.613671:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454921344:0@lo:400:kworker.0 00000100:00100000:3.0:1789545687.613682:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876474454920960:0@lo:400:kworker.0 00010000:00080000:3.0:1789545687.613706:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bc9c1f100 x1876474454921472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545687.613716:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454921472:0@lo:400:kworker.0 00010000:00010000:0.0:1789545687.878007:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789545688.060875:0:11484:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 04:01:26 (1789545686) === 00000100:00100000:1.0:1789545688.125518:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454921600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789545688.125584:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545688.125650:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454921600 00000100:00100000:1.0:1789545688.125658:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454921600 00000100:00100000:1.0:1789545688.125700:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789545688.125709:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454921600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789545688.125740:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789545688.125782:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454921600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545688.125792:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1789545688.125850:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be518c000 x1876474454921600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545704 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545688.125867:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454921600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789545688.126029:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454921728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789545688.126067:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545688.126101:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454921728 00000100:00100000:3.0:1789545688.126106:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454921728 00000100:00100000:3.0:1789545688.126123:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789545688.126128:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454921728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789545688.126147:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789545688.126180:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454921728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545688.126185:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1789545688.126214:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bc9c1f100 x1876474454921728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545704 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545688.126227:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454921728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789545688.326319:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545688.326388:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545688.326491:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438107008 00000100:00100000:2.0:1789545688.326503:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438107008 00000100:00100000:2.0:1789545688.326571:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 0 00000100:00100000:2.0:1789545688.326582:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8a8edb7a-f384-4468-93f4-9d664f284862+6:9715:x1876474438107008:12345-192.168.201.16@tcp:700:mkdir.0 00000100:00100000:2.0:1789545688.326665:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8a8edb7a-f384-4468-93f4-9d664f284862+6:9715:x1876474438107008:12345-192.168.201.16@tcp:700:mkdir.0 Request processed in 84us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545688.326673:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 0 00000100:00080000:0.0:1789545688.326896:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789545688.330157:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438106880 00000100:00100000:2.0:1789545688.330172:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438106880 00000100:00100000:2.0:1789545688.330237:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 14 00000100:00100000:2.0:1789545688.330247:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+6:2358:x1876474438106880:12345-192.168.201.16@tcp:41:mkdir.0 00000004:00000024:2.0:1789545688.330285:0:5848:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789545688.330389:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+6:2358:x1876474438106880:12345-192.168.201.16@tcp:41:mkdir.0 Request processed in 142us (4079us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545688.330396:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 14 00000100:00100000:1.0:1789545688.332819:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545688.332904:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438107264 00000100:00100000:3.0:1789545688.332913:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438107264 00000100:00100000:3.0:1789545688.333121:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 15 00000100:00100000:3.0:1789545688.333131:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+6:9715:x1876474438107264:12345-192.168.201.16@tcp:36:mkdir.0 00010000:00010000:3.0:1789545688.333179:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545688.333249:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c05e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5346 expref: 6 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.333266:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4f9e800) 00010000:00010000:3.0:1789545688.333288:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789545688.333677:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e200/0x64919c0f856c0703 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.333690:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e200/0x64919c0f856c0703 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.333698:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e200/0x64919c0f856c0703 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.333723:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c070a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.333731:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c070a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.333737:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c070a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545688.337688:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789545688.337710:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e200/0x64919c0f856c0703 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.337721:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e200/0x64919c0f856c0703 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.337729:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e200/0x64919c0f856c0703 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.337736:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217e200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545688.337740:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e200/0x64919c0f856c0703 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.337760:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e200/0x64919c0f856c0703 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.337777:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4f9e500) 00010000:00010000:3.0:1789545688.337780:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545688.337786:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e200/0x64919c0f856c0703 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.337793:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e200/0x64919c0f856c0703 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789545688.337814:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bca66dcb reply state 0000000066525e84 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c070a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545688.337823:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789545688.337927:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+7:9715:x1876474438107264:12345-192.168.201.16@tcp:36:mkdir.0 Request processed in 4793us (5110us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789545688.337936:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 15 00010000:00010000:0.0:1789545688.343819:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c070a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.343837:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c070a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.343845:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c070a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.343905:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217fc00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545688.343909:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c070a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.343916:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c070a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.343935:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff994bc4f9ee00) 00010000:00010000:0.0:1789545688.343938:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545688.343942:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c070a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.343948:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c070a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545688.353754:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545688.353953:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438107392 00000100:00100000:2.0:1789545688.353964:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438107392 00000100:00100000:2.0:1789545688.354019:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 16 00000100:00100000:2.0:1789545688.354030:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+6:9716:x1876474438107392:12345-192.168.201.16@tcp:101:chmod.0 00010000:00010000:2.0:1789545688.354063:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545688.354096:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0711 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de53cb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.354166:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0718 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.354179:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.354193:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545688.354233:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789545688.354237:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789545688.354271:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.354297:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0711 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53cb expref: 8 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.354329:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0718 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53cb expref: 7 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.354338:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bcd248d00) 00010000:00010000:2.0:1789545688.354341:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789545688.354404:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0000, rc 0) 00000100:00100000:2.0:1789545688.354461:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+7:9716:x1876474438107392:12345-192.168.201.16@tcp:101:chmod.0 Request processed in 431us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545688.354468:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 16 00000100:00100000:2.0:1789545688.364672:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545688.364761:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438107648 00000100:00100000:1.0:1789545688.364770:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438107648 00000100:00100000:1.0:1789545688.364855:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 17 00000100:00100000:1.0:1789545688.364865:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+7:9716:x1876474438107648:12345-192.168.201.16@tcp:36:chmod.0 00010000:00010000:1.0:1789545688.364932:0:10125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545688.364959:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0718 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53cb expref: 7 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.364978:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bcd248d00) 00010000:00010000:1.0:1789545688.364988:0:10125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789545688.365013:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c071f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.365026:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c071f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.365035:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c071f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789545688.365406:0:10125:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5e01141 reply state 00000000cde16424 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c071f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545688.365415:0:10125:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789545688.365423:0:10125:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789545688.365699:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+8:9716:x1876474438107648:12345-192.168.201.16@tcp:36:chmod.0 Request processed in 834us (1034us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789545688.365707:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 17 00010000:00010000:3.0:1789545688.369445:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c071f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.369463:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c071f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.369482:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c071f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.369488:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba9c00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545688.369493:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c071f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.369515:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c071f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.369531:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4ffec00) 00010000:00010000:3.0:1789545688.369534:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789545688.369540:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c071f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.369546:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c071f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545688.397535:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545688.397639:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438107776 00000100:00100000:3.0:1789545688.397659:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438107776 00000100:00100000:3.0:1789545688.397722:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 18 00000100:00100000:3.0:1789545688.397734:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+7:9717:x1876474438107776:12345-192.168.201.16@tcp:101:chown.0 00010000:00010000:3.0:1789545688.397768:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545688.397792:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e200/0x64919c0f856c0726 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de53d2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.397863:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c072d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.397877:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c072d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.397889:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c072d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545688.397926:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789545688.397930:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789545688.397989:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c072d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.398017:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e200/0x64919c0f856c0726 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53d2 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.398038:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c072d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53d2 expref: 8 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.398061:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4f9e500) 00010000:00010000:3.0:1789545688.398064:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789545688.398068:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217fe00, rc 0) 00000100:00100000:3.0:1789545688.398130:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+8:9717:x1876474438107776:12345-192.168.201.16@tcp:101:chown.0 Request processed in 399us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545688.398138:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 18 00000100:00100000:1.0:1789545688.405173:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545688.405282:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438107904 00000100:00100000:3.0:1789545688.405292:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438107904 00000100:00100000:3.0:1789545688.405354:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 19 00000100:00100000:2.0:1789545688.405584:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+8:9717:x1876474438107904:12345-192.168.201.16@tcp:101:chown.0 00010000:00010000:2.0:1789545688.405607:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545688.405640:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1800/0x64919c0f856c0734 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de53d9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.405713:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c073b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.405727:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c073b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.405737:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c073b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.405749:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0742 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.405867:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0742 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.405874:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0742 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.405952:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0749 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.405972:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.405979:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545688.406010:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789545688.406014:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789545688.406032:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.406044:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c073b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.406064:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c073b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.406071:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c073b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.406077:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1600 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545688.406081:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c073b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.406089:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c073b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.406101:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4f9e500) 00010000:00010000:2.0:1789545688.406104:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545688.406108:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c073b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.406123:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c073b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.406136:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0742 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.406141:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0742 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.406146:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0742 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.406150:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545688.406152:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0742 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.406158:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0742 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.406164:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff994bcd248400) 00010000:00010000:2.0:1789545688.406167:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545688.406169:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0742 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.406175:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0742 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.406204:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1800/0x64919c0f856c0734 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53d9 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.406217:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0749 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53d9 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.406229:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff994bcd248e00) 00010000:00010000:2.0:1789545688.406231:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789545688.406234:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0c00, rc 0) 00000100:00100000:2.0:1789545688.406301:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+9:9717:x1876474438107904:12345-192.168.201.16@tcp:101:chown.0 Request processed in 796us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545688.411278:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 19 00000100:00100000:2.0:1789545688.412246:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545688.412312:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438108160 00000100:00100000:0.0:1789545688.412322:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438108160 00000100:00100000:0.0:1789545688.412479:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 20 00000100:00100000:0.0:1789545688.412499:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+9:9717:x1876474438108160:12345-192.168.201.16@tcp:36:chown.0 00010000:00010000:0.0:1789545688.412566:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789545688.412591:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0749 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53d9 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.412611:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff994bcd248e00) 00010000:00010000:0.0:1789545688.412622:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789545688.412671:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031000/0x64919c0f856c0750 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.412684:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031000/0x64919c0f856c0750 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.412694:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031000/0x64919c0f856c0750 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789545688.444111:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1789545688.444233:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e1e0405 reply state 0000000074f4770c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031000/0x64919c0f856c0750 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545688.444248:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789545688.444263:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1789545688.444398:0:5847:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789545688.444415:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+7:9717:x1876474438108160:12345-192.168.201.16@tcp:36:chown.0 Request processed in 31923us (32169us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789545688.444424:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 20 00010000:00010000:0.0:1789545688.444458:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031000/0x64919c0f856c0750 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.444467:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031000/0x64919c0f856c0750 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.444476:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031000/0x64919c0f856c0750 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.444494:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc0031000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545688.444498:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031000/0x64919c0f856c0750 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.444507:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031000/0x64919c0f856c0750 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.444522:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:0.0:1789545688.444525:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789545688.444530:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031000/0x64919c0f856c0750 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.444536:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031000/0x64919c0f856c0750 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545688.469591:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545688.469700:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438108288 00000100:00100000:1.0:1789545688.469712:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438108288 00000100:00100000:1.0:1789545688.469801:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 21 00000100:00100000:1.0:1789545688.469809:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+6:9718:x1876474438108288:12345-192.168.201.16@tcp:101:touch.500 00010000:00010000:1.0:1789545688.469833:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545688.469862:0:10125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c0757 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de53e0 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789545688.473190:0:10125:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3281us 00010000:00010000:0.0:1789545688.480244:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031000/0x64919c0f856c075e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.480268:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031000/0x64919c0f856c075e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.480280:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031000/0x64919c0f856c075e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.480295:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031800/0x64919c0f856c0765 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.480303:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031800/0x64919c0f856c0765 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.480322:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031800/0x64919c0f856c0765 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.480643:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0030400/0x64919c0f856c076c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.480652:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0030400/0x64919c0f856c076c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.480660:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0030400/0x64919c0f856c076c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789545688.480683:0:10125:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789545688.480687:0:10125:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789545688.480724:0:10125:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0030400/0x64919c0f856c076c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.480738:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031000/0x64919c0f856c075e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.480745:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031000/0x64919c0f856c075e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.480753:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031000/0x64919c0f856c075e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.480759:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc0031000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545688.480764:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031000/0x64919c0f856c075e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.480772:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031000/0x64919c0f856c075e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.480793:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4f9e500) 00010000:00010000:0.0:1789545688.480795:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545688.480800:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031000/0x64919c0f856c075e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.480806:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031000/0x64919c0f856c075e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.480818:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031800/0x64919c0f856c0765 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.480825:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031800/0x64919c0f856c0765 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.480831:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031800/0x64919c0f856c0765 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.480837:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc0031800 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545688.480840:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031800/0x64919c0f856c0765 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.480847:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031800/0x64919c0f856c0765 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.480854:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff994bc4f11a00) 00010000:00010000:0.0:1789545688.480856:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545688.480859:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031800/0x64919c0f856c0765 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.480865:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031800/0x64919c0f856c0765 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.480915:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c0757 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53e0 expref: 8 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.480931:0:10125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0030400/0x64919c0f856c076c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53e0 expref: 7 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.480939:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff994bc4f11e00) 00010000:00010000:0.0:1789545688.480941:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789545688.480944:0:10125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc0030400, rc 0) 00000100:00100000:0.0:1789545688.481022:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+7:9718:x1876474438108288:12345-192.168.201.16@tcp:101:touch.500 Request processed in 11212us (11440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545688.481031:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 21 00000100:00100000:3.0:1789545688.485770:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545688.485850:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438108544 00000100:00100000:2.0:1789545688.485861:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438108544 00000100:00100000:2.0:1789545688.485920:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 22 00000100:00100000:2.0:1789545688.485931:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+7:9718:x1876474438108544:12345-192.168.201.16@tcp:101:touch.500 00010000:00010000:2.0:1789545688.485952:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545688.485972:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c0773 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de53e7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.486246:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c077a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.486261:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c077a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.486272:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c077a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.486286:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c0781 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.486300:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c0781 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.486306:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c0781 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789545688.487283:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1789545688.487598:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0788 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.487611:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0788 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.487621:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0788 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.487668:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c077a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.487676:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c077a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.487682:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c077a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.487688:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1e00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545688.487692:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c077a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.487699:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c077a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.487721:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff994bc4f11e00) 00010000:00010000:2.0:1789545688.487724:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545688.487730:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c077a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.487736:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c077a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789545688.487747:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008bd1a515 reply state 0000000046e5e2b0 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c0781 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545688.487755:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789545688.487787:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c0773 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53e7 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.487801:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0788 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53e7 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.487808:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff994bcd248e00) 00010000:00010000:2.0:1789545688.487811:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789545688.487813:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1200, rc 0) 00000100:00100000:2.0:1789545688.487876:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+10:9718:x1876474438108544:12345-192.168.201.16@tcp:101:touch.500 Request processed in 1946us (2115us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789545688.487884:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 22 00010000:00010000:0.0:1789545688.492716:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c0781 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.492736:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c0781 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.492745:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c0781 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.492752:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1c00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545688.492757:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c0781 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.492766:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c0781 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.492784:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2036a5dd (ffff994bcd248400) 00010000:00010000:0.0:1789545688.492798:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545688.492804:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c0781 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.492811:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c0781 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545688.492952:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545688.493332:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438108800 00000100:00100000:1.0:1789545688.493343:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438108800 00000100:00100000:1.0:1789545688.493725:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 23 00000100:00100000:1.0:1789545688.493737:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+9:9718:x1876474438108800:12345-192.168.201.16@tcp:36:touch.500 00010000:00010000:1.0:1789545688.493794:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545688.493817:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0788 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53e7 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.493831:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff994bcd248e00) 00010000:00010000:1.0:1789545688.493838:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789545688.493887:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0796 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.493899:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0796 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.493908:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0796 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789545688.494033:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e84fd5e reply state 000000006e14da48 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0796 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545688.494042:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789545688.494150:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+10:9718:x1876474438108800:12345-192.168.201.16@tcp:36:touch.500 Request processed in 415us (1201us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789545688.494157:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 23 00000100:00100000:2.0:1789545688.496616:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:3.0:1789545688.496659:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0796 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.496670:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0796 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.496678:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0796 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.496684:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba8800 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545688.496689:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0796 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.496709:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0796 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.496724:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff994bc4ffe700) 00010000:00010000:3.0:1789545688.496727:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545688.496731:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0796 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.496737:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0796 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545688.498236:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545688.498261:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545688.498793:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438108928 00000100:00100000:0.0:1789545688.498913:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438108928 00000100:00100000:0.0:1789545688.500951:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 24 00000100:00100000:0.0:1789545688.501203:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+9:9718:x1876474438108928:12345-192.168.201.16@tcp:101:touch.500 00010000:00010000:0.0:1789545688.501807:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545688.501955:0:10125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031800/0x64919c0f856c079d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de53ee expref: -99 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.502043:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031800/0x64919c0f856c079d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53ee expref: 10 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.502104:0:10125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031800/0x64919c0f856c079d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53ee expref: 10 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.502125:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:0.0:1789545688.502128:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789545688.502132:0:10125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc0031800, rc 0) 00000100:00100000:0.0:1789545688.502203:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+10:9718:x1876474438108928:12345-192.168.201.16@tcp:101:touch.500 Request processed in 1240us (5593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545688.502211:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 24 00000100:00100000:0.0:1789545688.502816:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438109056 00000100:00100000:3.0:1789545688.502822:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438109184 00000100:00100000:0.0:1789545688.502826:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438109056 00000100:00100000:3.0:1789545688.502829:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438109184 00000100:00100000:0.0:1789545688.502884:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 247 00000100:00100000:0.0:1789545688.502893:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2359:x1876474438109056:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:0.0:1789545688.502926:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2359:x1876474438109056:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 35us (4697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545688.502934:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 247 00000100:00100000:3.0:1789545688.505545:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 97 00000100:00100000:3.0:1789545688.505559:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2359:x1876474438109184:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:3.0:1789545688.505648:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2359:x1876474438109184:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 92us (7384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545688.505655:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 97 00000100:00080000:0.0:1789545688.505822:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789545688.507588:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545688.507704:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438109312 00000100:00100000:3.0:1789545688.507714:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438109312 00000100:00100000:3.0:1789545688.507755:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 16 00000100:00100000:3.0:1789545688.507764:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1876474438109312:12345-192.168.201.16@tcp:8:touch.500 00010000:00080000:3.0:1789545688.507793:0:6691:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 8a8edb7a-f384-4468-93f4-9d664f284862@192.168.201.16@tcp t0 exp 0000000000000000 cur 302 last 0 00000020:00000080:3.0:1789545688.507826:0:6691:0:(genops.c:1384:class_connect()) connect: client 8a8edb7a-f384-4468-93f4-9d664f284862, cookie 0x64919c0f856c07a4 00002000:00100000:3.0:1789545688.507838:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8a8edb7a-f384-4468-93f4-9d664f284862/ffff994bdfcb2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789545688.507861:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789545688.508120:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789545688.508150:0:6691:0:(import.c:65:import_set_state_nolock()) ffff994bdfcb4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789545688.508212:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+6:2357:x1876474438109312:12345-192.168.201.16@tcp:8:touch.500 Request processed in 447us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545688.508220:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 16 00000100:00100000:3.0:1789545688.511244:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545688.511398:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438109440 00000100:00100000:0.0:1789545688.511407:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438109440 00000100:00100000:0.0:1789545688.511472:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 17 00000100:00100000:0.0:1789545688.511485:0:8211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a8edb7a-f384-4468-93f4-9d664f284862+6:0:x1876474438109440:12345-192.168.201.16@tcp:2:touch.500 00000100:00080000:2.0:1789545688.511722:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789545688.547161:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:3.0:1789545688.547180:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8a8edb7a-f384-4468-93f4-9d664f284862 00000100:00100000:0.0:1789545688.547645:0:8211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a8edb7a-f384-4468-93f4-9d664f284862+5:0:x1876474438109440:12345-192.168.201.16@tcp:2:touch.500 Request processed in 36157us (36404us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789545688.547657:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 17 00000100:00100000:2.0:1789545688.555450:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545688.556081:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438109696 00000100:00100000:3.0:1789545688.556093:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438109696 00000100:00100000:3.0:1789545688.556147:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2 00000100:00100000:3.0:1789545688.556157:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+10:9718:x1876474438109696:12345-192.168.201.16@tcp:35:touch.500 00000100:00100000:3.0:1789545688.556528:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+11:9718:x1876474438109696:12345-192.168.201.16@tcp:35:touch.500 Request processed in 372us (1088us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789545688.556534:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2 00000100:00100000:2.0:1789545688.575029:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545688.575098:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438109824 00000100:00100000:0.0:1789545688.575107:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438109824 00000100:00100000:0.0:1789545688.575160:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 25 00000100:00100000:0.0:1789545688.575172:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+11:9719:x1876474438109824:12345-192.168.201.16@tcp:101:rm.0 00010000:00010000:0.0:1789545688.575195:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545688.575210:0:10125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031000/0x64919c0f856c07ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de53f5 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.575298:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7a00/0x64919c0f856c07b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.575313:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7a00/0x64919c0f856c07b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.575337:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7a00/0x64919c0f856c07b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545688.576170:0:10125:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789545688.576176:0:10125:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789545688.576233:0:10125:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7a00/0x64919c0f856c07b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.576263:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031000/0x64919c0f856c07ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53f5 expref: 13 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.576283:0:10125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7a00/0x64919c0f856c07b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53f5 expref: 12 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.576291:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff994bc4f11e00) 00010000:00010000:2.0:1789545688.576294:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789545688.576297:0:10125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb7a00, rc 0) 00000100:00100000:2.0:1789545688.576424:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+12:9719:x1876474438109824:12345-192.168.201.16@tcp:101:rm.0 Request processed in 1254us (1403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545688.576432:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 25 00000100:00100000:3.0:1789545688.584833:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545688.585123:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438110080 00000100:00100000:2.0:1789545688.585133:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438110080 00000100:00100000:2.0:1789545688.585190:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 26 00000100:00100000:2.0:1789545688.585201:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+12:9719:x1876474438110080:12345-192.168.201.16@tcp:101:rm.0 00010000:00010000:2.0:1789545688.585221:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545688.585240:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c07b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de53fc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545688.585337:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789545688.585553:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c07b9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53fc expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.585569:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4f9e500) 00010000:00010000:2.0:1789545688.585572:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789545688.585578:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c07b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53fc expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.585592:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1e00, rc 0) 00000100:00100000:2.0:1789545688.588923:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+13:9719:x1876474438110080:12345-192.168.201.16@tcp:101:rm.0 Request processed in 447us (833us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1789545688.589137:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 26 00000100:00100000:0.0:1789545688.598221:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545688.598282:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438110208 00000100:00100000:2.0:1789545688.598292:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438110208 00000100:00100000:2.0:1789545688.598488:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3 00000100:00100000:2.0:1789545688.598496:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+13:9719:x1876474438110208:12345-192.168.201.16@tcp:37:rm.0 00000100:00100000:2.0:1789545688.603895:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+13:9719:x1876474438110208:12345-192.168.201.16@tcp:37:rm.0 Request processed in 5387us (5688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545688.603910:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3 00000100:00100000:1.0:1789545688.607986:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545688.608069:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438110464 00000100:00100000:3.0:1789545688.608080:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438110464 00000100:00100000:3.0:1789545688.608141:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 4 00000100:00100000:3.0:1789545688.608154:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8cc7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+13:9719:x1876474438110464:12345-192.168.201.16@tcp:35:rm.0 00000100:00100000:3.0:1789545688.608415:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8cc7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+14:9719:x1876474438110464:12345-192.168.201.16@tcp:35:rm.0 Request processed in 264us (436us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789545688.608424:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 4 00000100:00100000:0.0:1789545688.611262:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545688.611326:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438110720 00000100:00100000:3.0:1789545688.611338:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438110720 00000100:00100000:2.0:1789545688.611498:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 27 00000100:00100000:2.0:1789545688.611507:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+14:9719:x1876474438110720:12345-192.168.201.16@tcp:101:rm.0 00010000:00010000:2.0:1789545688.611527:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545688.611542:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c07c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5403 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.611637:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c07ce lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.611668:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c07ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.611680:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c07ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545688.611693:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789545688.611836:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c07c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5403 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.611855:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c07ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5403 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.611864:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff994bc4f11e00) 00010000:00010000:2.0:1789545688.611867:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789545688.611871:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1c00, rc 0) 00000100:00100000:2.0:1789545688.611940:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+16:9719:x1876474438110720:12345-192.168.201.16@tcp:101:rm.0 Request processed in 434us (688us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789545688.611945:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 27 00000100:00100000:0.0:1789545688.615787:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545688.615852:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438110848 00000100:00100000:1.0:1789545688.615864:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438110848 00000100:00100000:1.0:1789545688.615930:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 28 00000100:00100000:1.0:1789545688.615939:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+16:9719:x1876474438110848:12345-192.168.201.16@tcp:41:rm.0 00000004:00000024:1.0:1789545688.615991:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1789545688.616059:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+16:9719:x1876474438110848:12345-192.168.201.16@tcp:41:rm.0 Request processed in 120us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545688.616065:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 28 00000100:00100000:1.0:1789545688.618440:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545688.618610:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438110976 00000100:00100000:2.0:1789545688.618620:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438110976 00000100:00100000:2.0:1789545688.618735:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 29 00000100:00100000:2.0:1789545688.618745:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+16:9719:x1876474438110976:12345-192.168.201.16@tcp:101:rm.0 00010000:00010000:2.0:1789545688.618765:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545688.618785:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c07dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de540a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.618881:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c07e3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.618896:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c07e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.618907:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c07e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.618922:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1800/0x64919c0f856c07ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.618929:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1800/0x64919c0f856c07ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.618936:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1800/0x64919c0f856c07ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.619033:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c07f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.620349:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c07f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.620428:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c07f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545688.620470:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789545688.620475:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789545688.620494:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c07f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.620523:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c07f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.620532:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c07e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.620539:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c07e3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.620545:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c07e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.620552:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545688.620556:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c07e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.620565:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c07e3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.620579:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff994bc4f11e00) 00010000:00010000:2.0:1789545688.620582:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545688.620588:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c07e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.620595:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c07e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.620609:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1800/0x64919c0f856c07ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.620615:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1800/0x64919c0f856c07ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.620695:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1800/0x64919c0f856c07ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.620701:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1800 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545688.620704:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1800/0x64919c0f856c07ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.620711:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1800/0x64919c0f856c07ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.620719:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2036a5dd (ffff994bcd248d00) 00010000:00010000:2.0:1789545688.620722:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545688.620725:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1800/0x64919c0f856c07ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.620731:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1800/0x64919c0f856c07ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.620773:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c07dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de540a expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.620787:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c07f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de540a expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.620794:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:2.0:1789545688.620797:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789545688.620799:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0c00, rc 0) 00000100:00100000:2.0:1789545688.622823:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+17:9719:x1876474438110976:12345-192.168.201.16@tcp:101:rm.0 Request processed in 4067us (4379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545688.622926:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 29 00000100:00100000:0.0:1789545688.627317:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545688.627472:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438111232 00000100:00100000:1.0:1789545688.627482:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438111232 00000100:00100000:1.0:1789545688.627585:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 30 00000100:00100000:1.0:1789545688.627596:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+17:9719:x1876474438111232:12345-192.168.201.16@tcp:36:rm.0 00010000:00010000:1.0:1789545688.627771:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789545688.627799:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c07f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de540a expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.627819:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0031800/0x64919c0f856c079d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53ee expref: 16 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.627831:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:1.0:1789545688.627859:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7a00/0x64919c0f856c07b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53f5 expref: 15 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.627869:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff994bc4f11e00) 00010000:00010000:1.0:1789545688.627872:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789545688.627892:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c07f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.627916:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c07f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.627927:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c07f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.627944:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c07ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.627952:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c07ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.627958:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c07ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.628109:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0806 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.628118:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0806 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.628124:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0806 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789545688.629124:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1789545688.629135:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 302551774842ns, next at 303551772593ns, rc = 0 00010000:00010000:1.0:1789545688.629199:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c080d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.629209:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c080d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.629227:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c080d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.629235:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c080d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.629242:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c080d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.629247:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c080d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.629267:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789545688.629287:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0806 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.629294:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0806 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.629297:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789545688.629306:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0806 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.629308:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c080d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.629313:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba9600 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545688.629318:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0806 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.629333:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba8800 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:1.0:1789545688.629335:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0806 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.629338:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c080d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.629351:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff994bc4ffe100) 00010000:00010000:1.0:1789545688.629355:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789545688.629397:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0806 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.629404:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0806 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.629422:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c07f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.629429:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c07f8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.629435:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c07f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.629440:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c080d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.629442:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba8200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545688.629447:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c07f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.629453:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c07f8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545688.629474:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff994bc4f11e00) 00010000:00010000:3.0:1789545688.629475:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff994bc4ffe100) 00010000:00010000:1.0:1789545688.629478:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545688.629481:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789545688.629483:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c07f8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.629487:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c080d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.629495:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c080d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545688.629511:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545688.629513:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545688.629515:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545688.629820:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c07f8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789545688.629832:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009b8fdac5 reply state 000000004a3b5f4a transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c07ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545688.629861:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789545688.629960:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+16:9719:x1876474438111232:12345-192.168.201.16@tcp:36:rm.0 Request processed in 2362us (2649us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789545688.629969:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 30 00010000:00010000:2.0:1789545688.632583:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c07ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.632601:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c07ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.632609:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c07ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.632615:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba8400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545688.632619:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c07ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.632626:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c07ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.632653:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2036a5dd (ffff994bc4ffe500) 00010000:00010000:2.0:1789545688.632656:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545688.632661:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c07ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.632666:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c07ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545688.636011:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545688.636252:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438111488 00000100:00100000:2.0:1789545688.636263:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438111488 00000100:00100000:2.0:1789545688.636320:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 5 00000100:00100000:2.0:1789545688.636331:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+15:9719:x1876474438111488:12345-192.168.201.16@tcp:35:rm.0 00000100:00100000:2.0:1789545688.636877:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+16:9719:x1876474438111488:12345-192.168.201.16@tcp:35:rm.0 Request processed in 546us (876us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789545688.636893:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 5 00000100:00100000:0.0:1789545688.640900:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545688.640981:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438111744 00000100:00100000:2.0:1789545688.640993:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438111744 00000100:00100000:2.0:1789545688.641066:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 31 00000100:00100000:2.0:1789545688.641077:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+16:9719:x1876474438111744:12345-192.168.201.16@tcp:36:rm.0 00010000:00010000:2.0:1789545688.641138:0:10125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789545688.641166:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c07ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5403 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.641189:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc0030400/0x64919c0f856c076c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53e0 expref: 15 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.641202:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff994bc4f11e00) 00010000:00010000:2.0:1789545688.641217:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c072d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53d2 expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.641226:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4f9e500) 00010000:00010000:2.0:1789545688.641232:0:10125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789545688.641253:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c0814 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.641264:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c0814 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.641273:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c0814 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.641285:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1800/0x64919c0f856c081b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.641306:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1800/0x64919c0f856c081b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.641313:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1800/0x64919c0f856c081b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.641612:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0822 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.641621:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0822 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.641640:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0822 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545688.642190:0:10125:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789545688.642205:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0822 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.642212:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0822 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.642220:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0822 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.642226:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545688.642230:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0822 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.642239:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0822 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.642258:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff994bcd248000) 00010000:00010000:2.0:1789545688.642261:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789545688.642265:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0822 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.642271:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0822 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.642288:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c0814 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.642293:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c0814 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.642298:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c0814 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.642303:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1600 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545688.642305:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c0814 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.642311:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c0814 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.642332:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bcd248d00) 00010000:00010000:2.0:1789545688.642335:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545688.642338:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c0814 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.642344:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c0814 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789545688.642399:0:10125:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a05cee57 reply state 0000000065aa4cb5 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1800/0x64919c0f856c081b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545688.642409:0:10125:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789545688.642483:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+15:9719:x1876474438111744:12345-192.168.201.16@tcp:36:rm.0 Request processed in 1408us (1591us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789545688.642492:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 31 00010000:00010000:0.0:1789545688.653205:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1800/0x64919c0f856c081b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.653226:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1800/0x64919c0f856c081b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.653234:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1800/0x64919c0f856c081b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.653241:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1800 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545688.653247:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1800/0x64919c0f856c081b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.653256:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1800/0x64919c0f856c081b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.653274:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff994bcd248700) 00010000:00010000:0.0:1789545688.653278:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545688.653283:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1800/0x64919c0f856c081b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545688.653307:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1800/0x64919c0f856c081b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545688.892788:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545689.916972:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545690.941460:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545691.964623:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545692.736664:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454922112:0@lo:400:kworker.0 00000100:00100000:2.0:1789545692.736736:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545692.736943:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876474454921984:0@lo:400:kworker.0 00000100:00100000:2.0:1789545692.737243:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789545692.737252:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454922240:0@lo:400:kworker.0 00000100:00100000:2.0:1789545692.737294:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545692.737337:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454922240 00000100:00100000:2.0:1789545692.737346:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454922240 00000100:00100000:2.0:1789545692.737426:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789545692.737436:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454922240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545692.737495:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454922240:12345-0@lo:400:kworker.0 Request processed in 60us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545692.737596:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454922112 00000100:00100000:0.0:1789545692.737601:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454922112 00000100:00100000:0.0:1789545692.737630:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789545692.737637:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454922112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545692.737681:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454922112:12345-0@lo:400:kworker.0 Request processed in 45us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545692.737687:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789545692.737790:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1789545692.737809:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789545692.737813:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789545692.737832:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545692.737940:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfc52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454921856:0@lo:400:kworker.0 00000100:00100000:1.0:1789545692.737989:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545692.738022:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454922368:0@lo:400:kworker.0 00000100:00100000:1.0:1789545692.738047:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545692.738077:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454921984 00000100:00100000:1.0:1789545692.738081:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454921984 00000100:00100000:1.0:1789545692.738104:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454922368 00000100:00100000:1.0:1789545692.738108:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454922368 00000100:00100000:1.0:1789545692.738130:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789545692.738137:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876474454921984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545692.738170:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876474454921984:12345-0@lo:400:kworker.0 Request processed in 32us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545692.738176:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789545692.738189:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789545692.738196:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454922368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545692.738228:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454922368:12345-0@lo:400:kworker.0 Request processed in 32us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545692.738234:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789545692.738252:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454921856 00000100:00100000:1.0:1789545692.738255:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454921856 00000100:00100000:1.0:1789545692.738293:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789545692.738299:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454921856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545692.738342:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454921856:12345-0@lo:400:kworker.0 Request processed in 43us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545692.738347:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789545692.738417:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfc52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454921856:0@lo:400:kworker.0 00000100:00100000:1.0:1789545692.738431:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454922368:0@lo:400:kworker.0 00000100:00100000:2.0:1789545692.738831:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876474454921984:0@lo:400:kworker.0 00000100:00100000:2.0:1789545692.738839:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454922496:0@lo:400:kworker.0 00000100:00100000:2.0:1789545692.738883:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789545692.738932:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789545692.738957:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be4b3ca80 x1876474454922240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545692.738979:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454922240:0@lo:400:kworker.0 00000100:00100000:2.0:1789545692.738992:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454922112:0@lo:400:kworker.0 00000100:00100000:1.0:1789545692.739911:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454922496 00000100:00100000:1.0:1789545692.739921:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454922496 00000100:00100000:1.0:1789545692.739997:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789545692.740006:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454922496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545692.740070:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454922496:12345-0@lo:400:kworker.0 Request processed in 66us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545692.740076:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1789545692.740394:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789545692.740426:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be4b3fb80 x1876474454922496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545692.740484:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454922496:0@lo:400:kworker.0 00000001:02000400:3.0:1789545692.839491:0:11633:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1789545692.990017:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545693.245088:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454922624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789545693.245161:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789545693.246319:0:6809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 307168958543ns, next at 308168956554ns, rc = 0 00000100:00100000:1.0:1789545693.246436:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789545693.246450:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454922752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789545693.246499:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545693.255776:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454922624 00000100:00100000:3.0:1789545693.255792:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454922624 00000100:00100000:3.0:1789545693.255841:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454922752 00000100:00100000:3.0:1789545693.255845:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454922752 00000100:00100000:3.0:1789545693.255865:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789545693.255874:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454922624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789545693.255914:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789545693.256005:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454922624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (10844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545693.256027:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789545693.256047:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789545693.256052:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454922752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789545693.256073:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789545693.256101:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454922752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (9603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545693.256107:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1789545693.259173:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be4b3c700 x1876474454922752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545709 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545693.259207:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454922752:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1789545693.259228:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be518d500 x1876474454922624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545709 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545693.259241:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454922624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789545693.620568:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545693.620600:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545693.620631:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545693.620678:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545693.620706:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438112000 00000100:00100000:1.0:1789545693.620715:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438112000 00000100:00100000:1.0:1789545693.620771:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438112256 00000100:00100000:1.0:1789545693.620774:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438112256 00000100:00100000:1.0:1789545693.620798:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 101 00000100:00100000:1.0:1789545693.620807:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+14:2361:x1876474438112000:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545693.620880:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+14:2361:x1876474438112000:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 73us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545693.620888:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 101 00000100:00100000:1.0:1789545693.620903:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 102 00000100:00100000:1.0:1789545693.620908:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2361:x1876474438112256:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545693.620927:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2361:x1876474438112256:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 20us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545693.620932:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 102 00000100:00100000:1.0:1789545693.621657:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438111872 00000100:00100000:1.0:1789545693.621664:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438111872 00000100:00100000:1.0:1789545693.621699:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 249 00000100:00100000:1.0:1789545693.621706:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2361:x1876474438111872:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545693.621737:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2361:x1876474438111872:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 32us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545693.621744:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 249 00000100:00100000:2.0:1789545693.622122:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438112128 00000100:00100000:2.0:1789545693.622128:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438112128 00000100:00100000:2.0:1789545693.622174:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 58 00000100:00100000:2.0:1789545693.622183:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+5:2361:x1876474438112128:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545693.622212:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+5:2361:x1876474438112128:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 31us (1534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545693.622219:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 58 00000100:00080000:2.0:1789545693.622238:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789545693.622242:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789545693.830083:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:0.0:1789545693.830096:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:0.0:1789545693.832989:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1789545693.836705:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:2.0:1789545693.843204:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789545693.843229:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454922880:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789545693.843309:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545693.843869:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454922880 00000100:00100000:1.0:1789545693.843878:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454922880 00000100:00100000:1.0:1789545693.843927:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789545693.843937:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454922880:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789545693.843981:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1789545693.844016:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aaa4cd8, atime: 0x6aaa4cd8, ctime: 0x6aaa4cd8, blocks: 0x1 00010000:00010000:1.0:1789545693.844025:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6682aee/0x64919c0f856c0829 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545693.844041:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=307s v=(0 0) 00010000:00010000:1.0:1789545693.844045:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789545693.844052:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6682aee/0x64919c0f856c0829 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545693.844071:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6682aee/0x64919c0f856c0829 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545693.844081:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6682aee/0x64919c0f856c0829 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545693.844089:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6682aee/0x64919c0f856c0829 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545693.844109:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789545693.844849:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1876474454922880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 911us (1537us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789545693.844859:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1789545693.844893:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789545693.844900:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6682aee/0x64919c0f856c0829 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545693.844922:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba8800 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:1.0:1789545693.844927:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6682aee/0x64919c0f856c0829 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545693.844938:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6682aee/0x64919c0f856c0829 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545693.845004:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6682aee/0x64919c0f856c0829 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545693.845014:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6682aee/0x64919c0f856c0829 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545693.845031:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545693.845033:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545693.845035:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789545693.847978:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff994bd8d9a680/2, rc 0, transno 4294967300 00000100:00100000:2.0:1789545693.847993:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454922880:0@lo:6:osp-syn-0-0.0 00000020:00000080:3.0:1789545693.939555:0:11682:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe9cfa73b0 20000000:00000080:3.0:1789545693.939573:0:11682:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff994bdb390400 uarg=0000000000000000 20000000:01000000:3.0:1789545693.939613:0:11682:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789545693.939619:0:11682:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789545693.939623:0:11682:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1789545693.942407:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1789545693.942598:0:11682:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1789545693.953092:0:11682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1789545693.953152:0:11682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1789545693.953208:0:11682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1789545693.953226:0:11682:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789545693.953246:0:11682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff994bc49d1e00/0x64919c0f856c0830 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.953264:0:11682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bc49d0a00/0x64919c0f856c06d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c06cb expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.953272:0:11682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bc8ba9400/0x64919c0f856c06e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c06d9 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.953279:0:11682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bc8ba9e00/0x64919c0f856c06ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c06e7 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.953288:0:11682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994c0217f600/0x64919c0f856c06f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53bd expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.953295:0:11682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bc8ba9000/0x64919c0f856c06fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53c4 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.953302:0:11682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff994bc49d1e00/0x64919c0f856c0830 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.953339:0:11682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bc8ba9000/0x64919c0f856c06fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53c4 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.953398:0:11682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994bc8ba9000/0x64919c0f856c06fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53c4 expref: 12 pid: 5840 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545693.953413:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11682:1876474454923008:192.168.201.16@tcp:104: 00010000:00010000:2.0:1789545693.956709:0:11682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994c0217f600/0x64919c0f856c06f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53bd expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.956729:0:11682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994c0217f600/0x64919c0f856c06f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53bd expref: 12 pid: 5838 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545693.956744:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11682:1876474454923136:192.168.201.16@tcp:104: 00010000:00010000:2.0:1789545693.956800:0:11682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bc8ba9e00/0x64919c0f856c06ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c06e7 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.956809:0:11682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994bc8ba9e00/0x64919c0f856c06ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c06e7 expref: 18 pid: 5838 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545693.956818:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11682:1876474454923264:0@lo:104: 00000100:00100000:2.0:1789545693.957068:0:11682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789545693.957111:0:11682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bc8ba9400/0x64919c0f856c06e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c06d9 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.957120:0:11682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994bc8ba9400/0x64919c0f856c06e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c06d9 expref: 18 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545693.957138:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11682:1876474454923392:0@lo:104: 00000100:00100000:2.0:1789545693.957162:0:11682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545693.957213:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454923264 00000100:00100000:2.0:1789545693.957222:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454923264 00000100:00100000:2.0:1789545693.957269:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454923392 00000100:00100000:2.0:1789545693.957273:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454923392 00000100:00100000:2.0:1789545693.957289:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789545693.957297:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+4:11682:x1876474454923264:12345-0@lo:104: 00010000:00010000:2.0:1789545693.957311:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994c0217fa00/0x64919c0f856c06e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c06ee expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.957377:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789545693.957383:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+4:11682:x1876474454923264:12345-0@lo:104: Request processed in 87us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545693.957391:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789545693.957411:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789545693.957417:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+3:11682:x1876474454923392:12345-0@lo:104: 00010000:00010000:2.0:1789545693.957424:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994c0217e400/0x64919c0f856c06d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c06e0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.957454:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789545693.957472:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+3:11682:x1876474454923392:12345-0@lo:104: Request processed in 55us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545693.957478:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1789545693.957498:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789545693.957503:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994c0217fa00/0x64919c0f856c06e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c06ee expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.957510:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217fa00 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:2.0:1789545693.957513:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994c0217fa00/0x64919c0f856c06e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c06ee expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.957532:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994c0217fa00/0x64919c0f856c06e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c06ee expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789545693.957538:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994c0217fa00/0x64919c0f856c06e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c06ee expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789545693.957543:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789545693.957575:0:8453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994c0217fa00/0x64919c0f856c06e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c06ee expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.957582:0:8453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789545693.957602:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994c0217fa00/0x64919c0f856c06e7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c06ee expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.957609:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994c0217fa00/0x64919c0f856c06e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c06ee expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.957624:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789545693.957628:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994c0217e400/0x64919c0f856c06d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c06e0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.957633:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217e400 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:2.0:1789545693.957636:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994c0217e400/0x64919c0f856c06d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c06e0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.957642:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994c0217e400/0x64919c0f856c06d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c06e0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789545693.957647:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994c0217e400/0x64919c0f856c06d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c06e0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789545693.957658:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789545693.957672:0:8453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994c0217e400/0x64919c0f856c06d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c06e0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.957677:0:8453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789545693.957692:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994c0217e400/0x64919c0f856c06d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c06e0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.957698:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994c0217e400/0x64919c0f856c06d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c06e0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.957708:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545693.957709:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545693.957710:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545693.957716:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545693.957726:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454923520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789545693.957754:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545693.957789:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beb86ab1-4563-44b1-afd1-f08a43b0622e:3313:1876474454923648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789545693.957810:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545693.957840:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454923520 00000100:00100000:2.0:1789545693.957844:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454923520 00010000:00010000:2.0:1789545693.958119:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bc8ba9e00/0x64919c0f856c06ee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c06e7 expref: 19 pid: 5838 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545693.958179:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454923648 00000100:00100000:2.0:1789545693.958182:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454923648 00010000:00010000:2.0:1789545693.958196:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bc8ba9400/0x64919c0f856c06e0 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c06d9 expref: 20 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545693.958585:0:11682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bc49d0a00/0x64919c0f856c06d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c06cb expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545693.958597:0:11682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994bc49d0a00/0x64919c0f856c06d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c06cb expref: 20 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545693.958608:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c1ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11682:1876474454923776:0@lo:104: 00000100:00100000:3.0:1789545693.958638:0:11682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545693.958667:0:11682:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc644b600 going to sleep for 11 seconds 00000100:00100000:3.0:1789545693.958685:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11682:1876474454923264:0@lo:104: 00000100:00100000:3.0:1789545693.958693:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11682:1876474454923392:0@lo:104: 00000100:00100000:0.0:1789545693.958750:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789545693.958762:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454923776 00000100:00100000:0.0:1789545693.958766:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454923776 00000100:00100000:0.0:1789545693.958801:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789545693.958809:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdb393050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+3:11682:x1876474454923776:12345-0@lo:104: 00010000:00010000:0.0:1789545693.958819:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9800/0x64919c0f856c06cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c06d2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545693.958863:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789545693.958869:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdb393050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+3:11682:x1876474454923776:12345-0@lo:104: Request processed in 61us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545693.958886:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1789545693.958928:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789545693.958933:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9800/0x64919c0f856c06cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c06d2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545693.958940:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba9800 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:0.0:1789545693.958943:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9800/0x64919c0f856c06cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c06d2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545693.958966:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9800/0x64919c0f856c06cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c06d2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789545693.958972:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9800/0x64919c0f856c06cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c06d2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789545693.958977:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789545693.958997:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9800/0x64919c0f856c06cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c06d2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545693.959003:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789545693.959020:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9800/0x64919c0f856c06cb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c06d2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545693.959025:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9800/0x64919c0f856c06cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c06d2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545693.959038:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545693.959040:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545693.959041:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789545693.959314:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c1ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11682:1876474454923776:0@lo:104: 00000100:00100000:1.0:1789545693.959689:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789545693.959701:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:beb86ab1-4563-44b1-afd1-f08a43b0622e+20:3312:x1876474454923520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789545693.959714:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545693.959721:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bc8ba9e00/0x64919c0f856c06ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c06e7 expref: 20 pid: 5838 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545693.959731:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bc8ba9e00/0x64919c0f856c06ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c06e7 expref: 20 pid: 5838 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545693.959754:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc8ba9e00/0x64919c0f856c06ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c06e7 expref: 20 pid: 5838 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545693.959765:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789545693.959814:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3312:x1876474454923520:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (2058us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545693.959820:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789545693.959838:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789545693.959844:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:3313:x1876474454923648:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789545693.960787:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454923520:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789545693.961327:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545693.961338:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bc8ba9400/0x64919c0f856c06e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c06d9 expref: 18 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545693.961350:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bc8ba9400/0x64919c0f856c06e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c06d9 expref: 18 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545693.961397:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc8ba9400/0x64919c0f856c06e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c06d9 expref: 18 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545693.961410:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789545693.961454:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:3313:x1876474454923648:12345-0@lo:103:ldlm_bl.0 Request processed in 1610us (3642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545693.961551:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789545693.962397:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beb86ab1-4563-44b1-afd1-f08a43b0622e:3314:1876474454923904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789545693.962447:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545693.962530:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beb86ab1-4563-44b1-afd1-f08a43b0622e:3313:1876474454923648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789545693.962654:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454923904 00000100:00100000:3.0:1789545693.962662:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454923904 00010000:00010000:3.0:1789545693.962691:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bc49d0a00/0x64919c0f856c06d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c06cb expref: 17 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545693.962726:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789545693.962734:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd9367c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:3314:x1876474454923904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789545693.962746:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545693.962750:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bc49d0a00/0x64919c0f856c06d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c06cb expref: 17 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545693.962759:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bc49d0a00/0x64919c0f856c06d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c06cb expref: 17 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545693.962773:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc49d0a00/0x64919c0f856c06d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c06cb expref: 17 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545693.962783:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545693.962818:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd9367c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:3314:x1876474454923904:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545693.962824:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789545693.963008:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beb86ab1-4563-44b1-afd1-f08a43b0622e:3314:1876474454923904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789545693.967813:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545693.967897:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438112384 00000100:00100000:2.0:1789545693.967906:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438112384 00010000:00010000:2.0:1789545693.967943:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bc8ba9000/0x64919c0f856c06fc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53c4 expref: 13 pid: 5840 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545693.967998:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 33 00000100:00100000:2.0:1789545693.968007:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2358:x1876474438112384:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789545693.968022:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545693.968028:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bc8ba9000/0x64919c0f856c06fc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53c4 expref: 13 pid: 5840 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.968039:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bc8ba9000/0x64919c0f856c06fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53c4 expref: 13 pid: 5840 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.968059:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789545693.968113:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2358:x1876474438112384:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 107us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545693.968120:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 33 00010000:00010000:3.0:1789545693.968767:0:11682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc8ba9000/0x64919c0f856c06fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53c4 expref: 12 pid: 5840 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545693.968784:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11682:1876474454923008:192.168.201.16@tcp:104: 00000100:00100000:3.0:1789545693.977569:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545693.977652:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11682:1876474454923136:192.168.201.16@tcp:104: 00010000:00010000:0.0:1789545693.977711:0:11682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff994bc49d1e00/0x64919c0f856c0830 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545693.979087:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438112512 00000100:00100000:2.0:1789545693.979099:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438112512 00010000:00010000:2.0:1789545693.979143:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994c0217f600/0x64919c0f856c06f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53bd expref: 12 pid: 5838 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545693.979198:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 34 00000100:00100000:2.0:1789545693.979207:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7941446-3286-4db8-8c2a-05ec7eed2433+12:2359:x1876474438112512:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789545693.979221:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545693.979226:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994c0217f600/0x64919c0f856c06f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53bd expref: 12 pid: 5838 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.979237:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994c0217f600/0x64919c0f856c06f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53bd expref: 12 pid: 5838 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.979256:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994c0217f600/0x64919c0f856c06f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de53bd expref: 12 pid: 5838 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.979273:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff994bc49d1e00/0x64919c0f856c0830 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.979282:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc49d1e00/0x64919c0f856c0830 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.979296:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994bc49d1e00/0x64919c0f856c0830 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.979303:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994bc49d1e00/0x64919c0f856c0830 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.979309:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff994bc49d1e00/0x64919c0f856c0830 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.979316:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff994bc49d1e00/0x64919c0f856c0830 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.979333:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1e00 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:2.0:1789545693.979336:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff994bc49d1e00/0x64919c0f856c0830 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.979343:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff994bc49d1e00/0x64919c0f856c0830 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.979353:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff994bc49d1e00/0x64919c0f856c0830 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545693.979395:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789545693.979454:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7941446-3286-4db8-8c2a-05ec7eed2433+11:2359:x1876474438112512:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 247us (1893us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545693.979473:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 34 00010000:00010000:0.0:1789545693.979662:0:11682:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff994bc49d1e00/0x64919c0f856c0830 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545693.979671:0:11682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff994bc49d1e00/0x64919c0f856c0830 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545693.979677:0:11682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc49d1e00/0x64919c0f856c0830 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545694.018547:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545695.036692:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789545695.100550:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789545695.100560:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994bdfb06800 from 7 10000000:01000000:0.0:1789545695.100565:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789545695.100714:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c0837 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545695.100729:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c0837 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545695.100741:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c0837 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545695.100978:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454924032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789545695.101051:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545695.101175:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8c2ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789545695.101563:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454924032 00000100:00100000:1.0:1789545695.101572:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454924032 00000100:00100000:1.0:1789545695.101722:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789545695.101732:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:5843:x1876474454924032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789545695.101769:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545695.101788:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc8ba9400/0x64919c0f856c083e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c0837 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545695.101811:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc8ba9400/0x64919c0f856c083e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c0837 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545695.101821:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc8ba9400/0x64919c0f856c083e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0837 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545695.101829:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba9400, rc 0) 00000100:00100000:1.0:1789545695.101887:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:5843:x1876474454924032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545695.101894:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789545695.101979:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454924032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789545695.101996:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c0837 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c083e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545695.102004:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c0837 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c083e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545695.102070:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454924160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789545695.102099:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545695.102289:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc8baba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789545695.102398:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454924160 00000100:00100000:0.0:1789545695.102404:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454924160 00000100:00100000:0.0:1789545695.102428:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789545695.102435:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:5843:x1876474454924160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789545695.102695:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:5843:x1876474454924160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545695.102703:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789545695.103252:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454924160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789545695.103297:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454924288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789545695.103338:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545695.103406:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc8baba80 going to sleep for 11 seconds 00000100:00100000:1.0:1789545695.103558:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454924288 00000100:00100000:1.0:1789545695.103564:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454924288 00000100:00100000:1.0:1789545695.103604:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789545695.103611:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:5843:x1876474454924288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789545695.103779:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:5843:x1876474454924288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545695.103785:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789545695.104125:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454924288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789545695.104617:0:11695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:11695:1876474454924416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789545695.104662:0:11695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545695.104698:0:11695:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8c2ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1789545695.104921:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454924416 00000100:00100000:1.0:1789545695.104938:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454924416 00000100:00100000:1.0:1789545695.104974:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789545695.104982:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:11695:x1876474454924416:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789545695.105155:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:11695:x1876474454924416:12345-0@lo:502:llog_process_th.0 Request processed in 174us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545695.105172:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789545695.105257:0:11695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:11695:1876474454924416:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789545695.105282:0:11695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789545695.105293:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545695.105296:0:11695:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789545695.105303:0:11695:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff994bdfb06800 00000020:00000080:2.0:1789545695.105305:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789545695.105410:0:11695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:11695:1876474454924544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789545695.105445:0:11695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545695.105466:0:11695:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc8baba80 going to sleep for 11 seconds 00000100:00100000:1.0:1789545695.107860:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454924544 00000100:00100000:1.0:1789545695.107872:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454924544 00000100:00100000:1.0:1789545695.107915:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1789545695.107924:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:11695:x1876474454924544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789545695.108175:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:11695:x1876474454924544:12345-0@lo:502:llog_process_th.0 Request processed in 252us (2729us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545695.108183:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789545695.108576:0:11695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:11695:1876474454924544:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789545695.108621:0:11695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789545695.108634:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789545695.108636:0:11695:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789545695.108641:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789545695.108771:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789545695.108793:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789545695.108802:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c0837 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c083e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545695.108812:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c0837 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c083e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789545695.108822:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789545695.108824:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994bc8231800 from 7 10000000:01000000:3.0:1789545695.108827:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789545695.108857:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994c0217ee00/0x64919c0f856c0845 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545695.108865:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994c0217ee00/0x64919c0f856c0845 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545695.108873:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994c0217ee00/0x64919c0f856c0845 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545695.108893:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454924672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789545695.108943:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545695.108981:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfc79600 going to sleep for 11 seconds 00000100:00100000:1.0:1789545695.109088:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454924672 00000100:00100000:1.0:1789545695.109094:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454924672 00000100:00100000:1.0:1789545695.109168:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789545695.109178:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bf56acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:5843:x1876474454924672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789545695.109189:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545695.109202:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc8ba9e00/0x64919c0f856c084c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c0845 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545695.109225:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc8ba9e00/0x64919c0f856c084c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c0845 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545695.109235:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc8ba9e00/0x64919c0f856c084c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0845 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545695.109244:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba9e00, rc 0) 00000100:00100000:1.0:1789545695.109279:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bf56acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:5843:x1876474454924672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545695.109285:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789545695.109683:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454924672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789545695.109699:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994c0217ee00/0x64919c0f856c0845 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c084c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545695.109708:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994c0217ee00/0x64919c0f856c0845 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c084c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545695.109764:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454924800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789545695.109794:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545695.110147:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc8bab600 going to sleep for 11 seconds 00000100:00100000:3.0:1789545695.110179:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454924800 00000100:00100000:3.0:1789545695.110186:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454924800 00000100:00100000:3.0:1789545695.110216:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789545695.110223:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:5843:x1876474454924800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789545695.110482:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:5843:x1876474454924800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545695.110495:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789545695.110933:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454924800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789545695.110969:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454924928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789545695.111008:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545695.111061:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc8bab600 going to sleep for 11 seconds 00000100:00100000:1.0:1789545695.111179:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454924928 00000100:00100000:1.0:1789545695.111189:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454924928 00000100:00100000:1.0:1789545695.111216:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789545695.111222:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:5843:x1876474454924928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789545695.111684:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:5843:x1876474454924928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 461us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545695.111692:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789545695.112509:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454924928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789545695.112719:0:11697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:11697:1876474454925056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789545695.112763:0:11697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545695.112791:0:11697:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc8baba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789545695.112860:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454925056 00000100:00100000:3.0:1789545695.112919:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454925056 00000100:00100000:3.0:1789545695.112955:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789545695.112961:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:11697:x1876474454925056:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789545695.113126:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:11697:x1876474454925056:12345-0@lo:502:llog_process_th.0 Request processed in 164us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545695.113133:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789545695.113214:0:11697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:11697:1876474454925056:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789545695.113235:0:11697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789545695.113245:0:11697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545695.113248:0:11697:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789545695.113254:0:11697:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff994bc8231800 00000020:00000080:2.0:1789545695.113257:0:11697:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789545695.113339:0:11697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:11697:1876474454925184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789545695.113401:0:11697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545695.113414:0:11697:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc8baba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789545695.113934:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454925184 00000100:00100000:0.0:1789545695.113940:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454925184 00000100:00100000:0.0:1789545695.113979:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789545695.113987:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:11697:x1876474454925184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789545695.114141:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:11697:x1876474454925184:12345-0@lo:502:llog_process_th.0 Request processed in 154us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545695.114147:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789545695.114182:0:11697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:11697:1876474454925184:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789545695.114201:0:11697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789545695.114206:0:11697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789545695.114207:0:11697:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789545695.114213:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789545695.114260:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789545695.114276:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789545695.114286:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994c0217ee00/0x64919c0f856c0845 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c084c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545695.114297:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994c0217ee00/0x64919c0f856c0845 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c084c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789545695.114306:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789545695.114313:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994bc4a49800 from 7 10000000:01000000:0.0:1789545695.114316:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789545695.114337:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994be4eb6e00/0x64919c0f856c0853 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545695.114345:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994be4eb6e00/0x64919c0f856c0853 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545695.114354:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994be4eb6e00/0x64919c0f856c0853 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545695.114460:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454925312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789545695.114487:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545695.114502:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8c2e300 going to sleep for 11 seconds 00000100:00100000:0.0:1789545695.114522:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454925312 00000100:00100000:0.0:1789545695.114525:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454925312 00000100:00100000:0.0:1789545695.114539:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789545695.114544:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:5843:x1876474454925312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789545695.114552:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545695.114562:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994be4eb6a00/0x64919c0f856c085a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c0853 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545695.114580:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994be4eb6a00/0x64919c0f856c085a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c0853 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545695.114589:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994be4eb6a00/0x64919c0f856c085a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c0853 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545695.114598:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb6a00, rc 0) 00000100:00100000:0.0:1789545695.114621:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:5843:x1876474454925312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545695.114635:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789545695.114661:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454925312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789545695.114672:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994be4eb6e00/0x64919c0f856c0853 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c085a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545695.114680:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994be4eb6e00/0x64919c0f856c0853 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c085a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545695.114714:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454925440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789545695.114734:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545695.114744:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8c2e300 going to sleep for 11 seconds 00000100:00100000:0.0:1789545695.114752:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454925440 00000100:00100000:0.0:1789545695.116478:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454925440 00000100:00100000:0.0:1789545695.116522:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789545695.116529:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:5843:x1876474454925440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789545695.116771:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:5843:x1876474454925440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 241us (2035us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545695.116779:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789545695.116832:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454925440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789545695.116871:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454925568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789545695.116907:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545695.116942:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8c2e300 going to sleep for 11 seconds 00000100:00100000:0.0:1789545695.116956:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454925568 00000100:00100000:0.0:1789545695.116960:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454925568 00000100:00100000:0.0:1789545695.116975:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789545695.116988:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:5843:x1876474454925568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789545695.117126:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:5843:x1876474454925568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545695.117132:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789545695.117168:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:beb86ab1-4563-44b1-afd1-f08a43b0622e:5843:1876474454925568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789545695.117716:0:11698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c1f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:11698:1876474454925696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789545695.117753:0:11698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545695.117787:0:11698:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfc79600 going to sleep for 11 seconds 00000100:00100000:2.0:1789545695.117827:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454925696 00000100:00100000:2.0:1789545695.117833:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454925696 00000100:00100000:2.0:1789545695.117866:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789545695.117873:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:11698:x1876474454925696:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789545695.118020:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:11698:x1876474454925696:12345-0@lo:502:llog_process_th.0 Request processed in 148us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545695.118027:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789545695.118104:0:11698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c1f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:11698:1876474454925696:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789545695.118127:0:11698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789545695.118135:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789545695.118138:0:11698:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789545695.118144:0:11698:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff994bc4a49800 00000020:00000080:3.0:1789545695.118147:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789545695.118326:0:11698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c1f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:11698:1876474454925824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789545695.118392:0:11698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545695.118408:0:11698:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfc79600 going to sleep for 11 seconds 00000100:00100000:2.0:1789545695.119211:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454925824 00000100:00100000:2.0:1789545695.119220:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454925824 00000100:00100000:2.0:1789545695.119262:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789545695.119269:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:11698:x1876474454925824:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789545695.119737:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:11698:x1876474454925824:12345-0@lo:502:llog_process_th.0 Request processed in 468us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545695.119745:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789545695.128603:0:11698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c1f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:beb86ab1-4563-44b1-afd1-f08a43b0622e:11698:1876474454925824:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789545695.128646:0:11698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789545695.128655:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789545695.128657:0:11698:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789545695.128662:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789545695.128805:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789545695.128831:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789545695.128842:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994be4eb6e00/0x64919c0f856c0853 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c085a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545695.128853:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994be4eb6e00/0x64919c0f856c0853 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c085a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789545695.133977:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789545695.857947:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545695.861969:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438112640 00000100:00100000:3.0:1789545695.861985:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438112640 00000100:00100000:3.0:1789545695.862059:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 265 00000100:00100000:3.0:1789545695.862070:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+11:5596:x1876474438112640:12345-192.168.201.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789545695.862087:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545695.862103:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994c0217e200/0x64919c0f856c0861 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5411 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545695.862131:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994c0217e200/0x64919c0f856c0861 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5411 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545695.862142:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994c0217e200/0x64919c0f856c0861 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5411 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545695.862152:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217e200, rc 0) 00000100:00100000:3.0:1789545695.862229:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+12:5596:x1876474438112640:12345-192.168.201.16@tcp:101:ll_cfg_requeue.0 Request processed in 161us (4290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545695.862237:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 265 00000100:00100000:2.0:1789545695.866259:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545695.866426:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438112768 00000100:00100000:1.0:1789545695.866437:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438112768 00000100:00100000:1.0:1789545695.866494:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 266 00000100:00100000:1.0:1789545695.866515:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+12:5596:x1876474438112768:12345-192.168.201.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789545695.866905:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+12:5596:x1876474438112768:12345-192.168.201.16@tcp:501:ll_cfg_requeue.0 Request processed in 401us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545695.866922:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 266 00000100:00100000:1.0:1789545695.878734:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545695.878957:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438112896 00000100:00100000:2.0:1789545695.878967:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438112896 00000100:00100000:2.0:1789545695.879035:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 267 00000100:00100000:2.0:1789545695.879046:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+12:5596:x1876474438112896:12345-192.168.201.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789545695.879277:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+12:5596:x1876474438112896:12345-192.168.201.16@tcp:503:ll_cfg_requeue.0 Request processed in 232us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545695.879294:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 267 00000100:00100000:0.0:1789545695.886061:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545695.886392:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438113024 00000100:00100000:3.0:1789545695.886402:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438113024 00000100:00100000:3.0:1789545695.886458:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 268 00000100:00100000:3.0:1789545695.886481:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+12:9989:x1876474438113024:12345-192.168.201.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789545695.886730:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+12:9989:x1876474438113024:12345-192.168.201.16@tcp:502:llog_process_th.0 Request processed in 250us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545695.886738:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 268 00000100:00100000:3.0:1789545695.890040:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545695.890144:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438113152 00000100:00100000:1.0:1789545695.890154:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438113152 00000100:00100000:1.0:1789545695.890206:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 269 00000100:00100000:1.0:1789545695.890216:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+12:9989:x1876474438113152:12345-192.168.201.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789545695.890505:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+12:9989:x1876474438113152:12345-192.168.201.16@tcp:502:llog_process_th.0 Request processed in 281us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545695.890513:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 269 00000100:00100000:1.0:1789545695.895630:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545695.896286:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438113280 00000100:00100000:2.0:1789545695.896296:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438113280 00000100:00100000:2.0:1789545695.896356:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 270 00000100:00100000:2.0:1789545695.896407:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bedeedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+12:5596:x1876474438113280:12345-192.168.201.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789545695.896425:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545695.896442:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc49d1800/0x64919c0f856c0868 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5418 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545695.896469:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc49d1800/0x64919c0f856c0868 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5418 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545695.896481:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc49d1800/0x64919c0f856c0868 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5418 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545695.896501:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1800, rc 0) 00000100:00100000:2.0:1789545695.896561:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bedeedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+13:5596:x1876474438113280:12345-192.168.201.16@tcp:101:ll_cfg_requeue.0 Request processed in 156us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545695.896580:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 270 00000100:00100000:0.0:1789545695.901860:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545695.901956:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438113408 00000100:00100000:3.0:1789545695.901966:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438113408 00000100:00100000:3.0:1789545695.902022:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 271 00000100:00100000:3.0:1789545695.902032:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+13:5596:x1876474438113408:12345-192.168.201.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789545695.903739:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+13:5596:x1876474438113408:12345-192.168.201.16@tcp:501:ll_cfg_requeue.0 Request processed in 1699us (1881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545695.903752:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 271 00000100:00100000:3.0:1789545695.915225:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545695.915441:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438113536 00000100:00100000:1.0:1789545695.915452:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438113536 00000100:00100000:1.0:1789545695.915516:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 272 00000100:00100000:1.0:1789545695.915539:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+13:5596:x1876474438113536:12345-192.168.201.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789545695.915762:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+13:5596:x1876474438113536:12345-192.168.201.16@tcp:503:ll_cfg_requeue.0 Request processed in 224us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545695.915770:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 272 00000100:00100000:1.0:1789545695.930737:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545695.934878:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438113664 00000100:00100000:3.0:1789545695.934894:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438113664 00000100:00100000:2.0:1789545695.935608:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 273 00000100:00100000:2.0:1789545695.935620:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8dde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+13:9992:x1876474438113664:12345-192.168.201.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789545695.935882:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8dde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+13:9992:x1876474438113664:12345-192.168.201.16@tcp:502:llog_process_th.0 Request processed in 264us (5154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545695.935891:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 273 00000100:00100000:0.0:1789545695.938275:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545695.938409:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438113792 00000100:00100000:2.0:1789545695.938418:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438113792 00000100:00100000:2.0:1789545695.938466:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 274 00000100:00100000:2.0:1789545695.938475:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+13:9992:x1876474438113792:12345-192.168.201.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789545695.938678:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+13:9992:x1876474438113792:12345-192.168.201.16@tcp:502:llog_process_th.0 Request processed in 204us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545695.938687:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 274 00010000:00010000:0.0:1789545696.063060:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789545696.195684:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789545697.087925:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545697.852618:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454925952:0@lo:400:kworker.0 00000100:00100000:0.0:1789545697.852680:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876474454926080:0@lo:400:kworker.0 00000100:00100000:1.0:1789545697.852686:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545697.852726:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545697.852746:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454926464:0@lo:400:kworker.0 00000100:00100000:0.0:1789545697.852756:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454926592:0@lo:400:kworker.0 00000100:00100000:1.0:1789545697.852777:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545697.852792:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545697.852817:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454926080 00000100:00100000:1.0:1789545697.852826:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454926080 00000100:00100000:0.0:1789545697.852833:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454926208:0@lo:400:kworker.0 00000100:00100000:0.0:1789545697.852863:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545697.852875:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454926464 00000100:00100000:1.0:1789545697.852888:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454926464 00000100:00100000:0.0:1789545697.852900:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789545697.852909:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be479aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454926336:0@lo:400:kworker.0 00000100:00100000:1.0:1789545697.852912:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454926208 00000100:00100000:1.0:1789545697.852915:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454926208 00000100:00100000:0.0:1789545697.852935:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545697.852949:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789545697.852959:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876474454926080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545697.852974:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454926592 00000100:00100000:1.0:1789545697.853012:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876474454926080:12345-0@lo:400:kworker.0 Request processed in 54us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545697.853018:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789545697.853045:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789545697.853052:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454926464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545697.853059:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454926592 00000100:00100000:1.0:1789545697.853095:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454926464:12345-0@lo:400:kworker.0 Request processed in 44us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545697.853102:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789545697.853114:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789545697.853127:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454926208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545697.853171:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454926336 00000100:00100000:0.0:1789545697.853176:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454926336 00000100:00100000:1.0:1789545697.855089:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454926208:12345-0@lo:400:kworker.0 Request processed in 1945us (2208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545697.855104:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:1.0:1789545697.855147:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789545697.855152:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789545697.855154:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789545697.857915:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789545697.857941:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be479b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454926592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545697.858604:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454926208:0@lo:400:kworker.0 00000100:00100000:2.0:1789545697.858644:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876474454926080:0@lo:400:kworker.0 00000100:00100000:2.0:1789545697.858673:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454926464:0@lo:400:kworker.0 00000100:00100000:2.0:1789545697.858701:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454925952 00000100:00100000:2.0:1789545697.858709:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454925952 00000100:00100000:2.0:1789545697.858907:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1789545697.858913:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be479b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454926592:12345-0@lo:400:kworker.0 Request processed in 982us (6119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545697.858929:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454925952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545697.858940:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789545697.858962:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789545697.858970:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1876474454926336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545697.859206:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454925952:12345-0@lo:400:kworker.0 Request processed in 290us (6520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545697.859219:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789545697.859261:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454925952:0@lo:400:kworker.0 00010000:00080000:1.0:1789545697.859770:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be4798e00 x1876474454926592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545697.859785:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454926592:0@lo:400:kworker.0 00000100:00100000:0.0:1789545697.859801:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1876474454926336:12345-0@lo:400:kworker.0 Request processed in 831us (6865us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545697.859811:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789545697.859834:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be479aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454926336:0@lo:400:kworker.0 00010000:00010000:2.0:1789545698.109308:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789545698.364621:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454926720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789545698.364693:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545698.364798:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789545698.364805:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454926848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789545698.364829:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545698.364919:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454926720 00000100:00100000:1.0:1789545698.364928:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454926720 00000100:00100000:1.0:1789545698.364965:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454926848 00000100:00100000:1.0:1789545698.364968:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454926848 00000100:00100000:1.0:1789545698.364985:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789545698.364993:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454926720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789545698.365030:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789545698.365086:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454926720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545698.365095:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789545698.365115:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789545698.365123:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876474454926848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789545698.365142:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789545698.365171:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876474454926848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545698.365195:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789545698.365298:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454926848:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1789545698.365322:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994bd8d99180 x1876474454926720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545714 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545698.365335:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454926720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789545698.738179:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545698.738221:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545698.738259:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545698.738279:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545698.738754:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438114176 00000100:00100000:2.0:1789545698.738764:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438114176 00000100:00100000:2.0:1789545698.738839:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 61 00000100:00100000:2.0:1789545698.738850:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a8edb7a-f384-4468-93f4-9d664f284862+5:2360:x1876474438114176:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545698.738928:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a8edb7a-f384-4468-93f4-9d664f284862+5:2360:x1876474438114176:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 81us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545698.738935:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 61 00000100:00080000:0.0:1789545698.738996:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789545698.739404:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438114048 00000100:00100000:1.0:1789545698.739410:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438114048 00000100:00100000:1.0:1789545698.739457:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438114304 00000100:00100000:1.0:1789545698.739461:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438114304 00000100:00100000:1.0:1789545698.739491:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 106 00000100:00100000:1.0:1789545698.739500:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+5:2360:x1876474438114048:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545698.739552:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+5:2360:x1876474438114048:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 40us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545698.739560:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 106 00000100:00100000:1.0:1789545698.739573:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 107 00000100:00100000:1.0:1789545698.739579:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2360:x1876474438114304:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545698.739604:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2360:x1876474438114304:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 25us (1324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545698.739609:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 107 00000100:00100000:1.0:1789545698.739631:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438113920 00000100:00100000:1.0:1789545698.739635:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438113920 00000100:00100000:1.0:1789545698.739656:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 276 00000100:00100000:1.0:1789545698.739663:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2360:x1876474438113920:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545698.739686:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2360:x1876474438113920:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 24us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545698.739692:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 276 00000100:00080000:0.0:1789545698.741053:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789545698.987096:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1789545699.134822:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545700.156649:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545701.183079:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545702.204702:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545702.974162:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454927360:0@lo:400:kworker.0 00000100:00100000:1.0:1789545702.974254:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545702.974305:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454927232:0@lo:400:kworker.0 00000100:00100000:3.0:1789545702.974353:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545702.974412:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454927360 00000100:00100000:1.0:1789545702.974421:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454927360 00000100:00100000:3.0:1789545702.974441:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454927232 00000100:00100000:3.0:1789545702.974447:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454927232 00000100:00100000:3.0:1789545702.974502:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789545702.974503:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789545702.974520:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454927360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545702.974533:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454927232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545702.974596:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454927232:12345-0@lo:400:kworker.0 Request processed in 81us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545702.974602:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454927360:12345-0@lo:400:kworker.0 Request processed in 86us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545702.974608:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789545702.974615:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1789545702.974644:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789545702.974650:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789545702.974671:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000100:00100000:3.0:1789545702.974677:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454927232:0@lo:400:kworker.0 00000004:00080000:1.0:1789545702.974678:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff994bd8d9a680, transno 4294967300 00000100:00100000:1.0:1789545702.974695:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454927360:0@lo:400:kworker.0 00000100:00100000:2.0:1789545702.975330:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454926976:0@lo:400:kworker.0 00000100:00100000:2.0:1789545702.975398:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545702.975437:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454927488:0@lo:400:kworker.0 00000100:00100000:2.0:1789545702.975464:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545702.975486:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789545702.975492:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454927104:0@lo:400:kworker.0 00000100:00100000:2.0:1789545702.975515:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545702.975533:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994becd93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454927616:0@lo:400:kworker.0 00000100:00100000:2.0:1789545702.975554:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545702.975584:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454927616 00000100:00100000:2.0:1789545702.975590:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454927616 00000100:00100000:2.0:1789545702.975633:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789545702.975641:0:8211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454927616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545702.975696:0:8211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454927616:12345-0@lo:400:kworker.0 Request processed in 56us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545702.975703:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789545702.975730:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454926976 00000100:00100000:2.0:1789545702.975733:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454926976 00000100:00100000:2.0:1789545702.975758:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789545702.975764:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454926976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545702.975812:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454926976:12345-0@lo:400:kworker.0 Request processed in 48us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545702.975819:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789545702.975848:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454927488 00000100:00100000:2.0:1789545702.975852:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454927488 00000100:00100000:2.0:1789545702.975873:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454927104 00000100:00100000:2.0:1789545702.975875:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454927104 00000100:00100000:2.0:1789545702.975890:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789545702.975897:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454927488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545702.975926:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454927488:12345-0@lo:400:kworker.0 Request processed in 30us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545702.975932:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789545702.975942:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789545702.975947:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454927104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545702.975971:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454927104:12345-0@lo:400:kworker.0 Request processed in 25us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545702.975976:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789545702.976026:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454927104:0@lo:400:kworker.0 00010000:00080000:2.0:1789545702.976040:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994becd93b80 x1876474454927616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545702.976057:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994becd93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454927616:0@lo:400:kworker.0 00000100:00100000:2.0:1789545702.976068:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454926976:0@lo:400:kworker.0 00000100:00100000:2.0:1789545702.976078:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454927488:0@lo:400:kworker.0 00000100:00080000:1.0:1789545702.978748:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789545702.978764:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789545703.229148:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545703.484841:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789545703.484874:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994becd93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454927744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789545703.484980:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545703.485189:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454927744 00000100:00100000:1.0:1789545703.485199:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454927744 00000100:00100000:1.0:1789545703.485268:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789545703.485278:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454927744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789545703.485327:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789545703.485423:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454927744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545703.485430:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1789545703.485556:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994becd93100 x1876474454927744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545719 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545703.485579:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994becd93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454927744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789545703.485990:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789545703.486005:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454927872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789545703.486044:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545703.486310:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454927872 00000100:00100000:1.0:1789545703.486318:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454927872 00000100:00100000:1.0:1789545703.486382:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789545703.486391:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454927872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789545703.486420:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789545703.486475:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454927872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545703.486500:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789545703.486589:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454927872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789545703.859835:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545703.859883:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545703.859921:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545703.860042:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438114560 00000100:00100000:2.0:1789545703.860052:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438114560 00000100:00100000:2.0:1789545703.860110:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438114816 00000100:00100000:2.0:1789545703.860114:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438114816 00000100:00100000:2.0:1789545703.860138:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 111 00000100:00100000:2.0:1789545703.860147:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+5:2361:x1876474438114560:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545703.860220:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+5:2361:x1876474438114560:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 74us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545703.860228:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 111 00000100:00100000:2.0:1789545703.860247:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 112 00000100:00100000:2.0:1789545703.860253:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2361:x1876474438114816:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545703.860279:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2361:x1876474438114816:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 26us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545703.860285:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 112 00000100:00080000:0.0:1789545703.860715:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789545703.862574:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545703.862803:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438114688 00000100:00100000:0.0:1789545703.862813:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438114688 00000100:00100000:0.0:1789545703.862894:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 64 00000100:00100000:0.0:1789545703.862905:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+5:2361:x1876474438114688:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:0.0:1789545703.862974:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+5:2361:x1876474438114688:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 71us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545703.862997:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 64 00000100:00080000:2.0:1789545703.863388:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789545703.866796:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438114432 00000100:00100000:1.0:1789545703.866815:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438114432 00000100:00100000:1.0:1789545703.866973:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 278 00000100:00100000:1.0:1789545703.866985:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2361:x1876474438114432:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545703.867081:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2361:x1876474438114432:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 98us (7158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545703.867090:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 278 00010000:00010000:2.0:1789545704.253832:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545705.279607:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545706.300581:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789545706.429039:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789545707.324589:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789545708.092703:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be479bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876474454928128:0@lo:400:kworker.0 00000100:00100000:3.0:1789545708.092791:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545708.092872:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789545708.092879:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454928000:0@lo:400:kworker.0 00000100:00100000:3.0:1789545708.092933:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545708.093016:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454928128 00000100:00100000:1.0:1789545708.093025:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454928128 00000100:00100000:1.0:1789545708.093086:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789545708.093097:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876474454928128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545708.093157:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876474454928128:12345-0@lo:400:kworker.0 Request processed in 62us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545708.093164:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789545708.093187:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454928000 00000100:00100000:1.0:1789545708.093191:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454928000 00000100:00100000:1.0:1789545708.093215:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789545708.093221:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3312:x1876474454928000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545708.093250:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3312:x1876474454928000:12345-0@lo:400:kworker.0 Request processed in 30us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545708.093257:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789545708.093303:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454928000:0@lo:400:kworker.0 00000100:00100000:1.0:1789545708.093315:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be479bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876474454928128:0@lo:400:kworker.0 00000100:00100000:1.0:1789545708.097745:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454928256:0@lo:400:kworker.0 00000100:00100000:1.0:1789545708.097839:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545708.098131:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454928384:0@lo:400:kworker.0 00000100:00100000:1.0:1789545708.098171:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545708.098246:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454928384 00000100:00100000:3.0:1789545708.098255:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454928384 00000100:00100000:3.0:1789545708.098321:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789545708.098341:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454928384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545708.098497:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454928512:0@lo:400:kworker.0 00000100:00100000:0.0:1789545708.098525:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545708.098562:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789545708.098568:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be479ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454928640:0@lo:400:kworker.0 00000100:00100000:0.0:1789545708.098591:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545708.098617:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454928256 00000100:00100000:0.0:1789545708.098621:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454928256 00000100:00100000:0.0:1789545708.098646:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454928512 00000100:00100000:0.0:1789545708.098649:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454928512 00000100:00100000:0.0:1789545708.098670:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789545708.098676:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454928256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545708.098708:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789545708.098716:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be479a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454928512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545708.098720:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454928256:12345-0@lo:400:kworker.0 Request processed in 45us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545708.098727:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789545708.098750:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454928640 00000100:00100000:0.0:1789545708.098754:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454928640 00000100:00100000:2.0:1789545708.098763:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be479a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454928512:12345-0@lo:400:kworker.0 Request processed in 48us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545708.098769:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789545708.098775:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789545708.098780:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be479a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454928640:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789545708.098798:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789545708.098802:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789545708.098804:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789545708.098807:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be479a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454928640:12345-0@lo:400:kworker.0 Request processed in 28us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545708.098814:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:0.0:1789545708.098844:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be479ad80 x1876474454928640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545708.098869:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be479ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454928640:0@lo:400:kworker.0 00000100:00100000:0.0:1789545708.098880:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454928512:0@lo:400:kworker.0 00000100:00100000:0.0:1789545708.098921:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454928256:0@lo:400:kworker.0 00000100:00100000:3.0:1789545708.103997:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454928384:12345-0@lo:400:kworker.0 Request processed in 5657us (5814us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545708.104013:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789545708.104582:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454928384:0@lo:400:kworker.0 00010000:00010000:0.0:1789545708.352385:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545708.604637:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454928768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789545708.604680:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be5192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454928896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789545708.604728:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545708.605146:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545708.612631:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454928768 00000100:00100000:1.0:1789545708.612649:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454928768 00000100:00100000:2.0:1789545708.614467:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454928896 00000100:00100000:2.0:1789545708.614483:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454928896 00000100:00100000:2.0:1789545708.614542:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789545708.614552:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454928768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789545708.614596:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789545708.614716:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454928768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (9988us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545708.614724:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789545708.614744:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789545708.614751:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454928896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789545708.614770:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789545708.614814:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454928896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (9668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545708.614820:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1789545708.615051:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be5192a00 x1876474454928896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545708.615073:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be5192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454928896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789545708.615232:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454928768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789545708.982143:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545708.982194:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545708.982421:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438115072 00000100:00100000:0.0:1789545708.982431:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438115072 00000100:00100000:0.0:1789545708.982501:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 116 00000100:00100000:0.0:1789545708.982511:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+5:2360:x1876474438115072:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:0.0:1789545708.982585:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+5:2360:x1876474438115072:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 75us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545708.982593:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 116 00000100:00080000:2.0:1789545708.982907:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789545708.983037:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438114944 00000100:00100000:1.0:1789545708.983042:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438114944 00000100:00100000:1.0:1789545708.983083:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 280 00000100:00100000:1.0:1789545708.983092:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2360:x1876474438114944:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545708.983123:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2360:x1876474438114944:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 33us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545708.983130:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 280 00000100:00100000:3.0:1789545709.002658:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545709.002720:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545709.002745:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438115200 00000100:00100000:2.0:1789545709.002757:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438115200 00000100:00100000:2.0:1789545709.002845:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 19 00000100:00100000:2.0:1789545709.002855:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+5:2357:x1876474438115200:12345-192.168.201.16@tcp:9:kworker.0 00000020:00000080:2.0:1789545709.002885:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c07a4 00000100:00080000:2.0:1789545709.002894:0:6691:0:(import.c:65:import_set_state_nolock()) ffff994bdfcb4000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789545709.002942:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1789545709.003215:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+2:2357:x1876474438115200:12345-192.168.201.16@tcp:9:kworker.0 Request processed in 361us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545709.003223:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 19 00010000:00010000:2.0:1789545709.003244:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545709.003537:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438115328 00000100:00100000:0.0:1789545709.003543:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438115328 00000100:00100000:0.0:1789545709.003585:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 117 00000100:00100000:0.0:1789545709.003595:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2361:x1876474438115328:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:0.0:1789545709.003629:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2361:x1876474438115328:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 36us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545709.003636:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 117 00000100:00080000:3.0:1789545709.003706:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789545709.003710:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1789545709.191161:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8a8edb7a-f384-4468-93f4-9d664f284862 00000020:00000080:2.0:1789545709.191170:0:6717:0:(genops.c:885:class_export_put()) final put ffff994bdfcb2800/8a8edb7a-f384-4468-93f4-9d664f284862 00000020:00000080:0.0:1789545709.191251:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff994bdfcb2800/8a8edb7a-f384-4468-93f4-9d664f284862 for lustre-OST0000 00000020:00000080:0.0:1789545709.191305:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff994bdfcb4000 for lustre-OST0000 00010000:00010000:2.0:1789545709.372578:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545710.399998:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545711.426721:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545712.448513:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545713.215148:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454929024:0@lo:400:kworker.0 00000100:00100000:1.0:1789545713.215228:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545713.215282:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454929536:0@lo:400:kworker.0 00000100:00100000:1.0:1789545713.215312:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545713.215340:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789545713.215347:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454929152:0@lo:400:kworker.0 00000100:00100000:1.0:1789545713.215388:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545713.215406:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454929664:0@lo:400:kworker.0 00000100:00100000:1.0:1789545713.215428:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545713.215458:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454929024 00000100:00100000:1.0:1789545713.215465:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454929024 00000100:00100000:1.0:1789545713.215505:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1789545713.215525:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454929024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545713.215587:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454929024:12345-0@lo:400:kworker.0 Request processed in 63us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545713.215594:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1789545713.215657:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454929024:0@lo:400:kworker.0 00000100:00100000:1.0:1789545713.215692:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454929536 00000100:00100000:1.0:1789545713.215695:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454929536 00000100:00100000:1.0:1789545713.215726:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454929152 00000100:00100000:1.0:1789545713.215728:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454929152 00000100:00100000:1.0:1789545713.215747:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789545713.215753:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454929536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545713.215788:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454929536:12345-0@lo:400:kworker.0 Request processed in 35us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545713.215794:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789545713.215805:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789545713.215810:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454929152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545713.215834:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454929152:12345-0@lo:400:kworker.0 Request processed in 24us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545713.215839:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789545713.215856:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454929280:0@lo:400:kworker.0 00000100:00100000:1.0:1789545713.215877:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545713.215895:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789545713.215900:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454929408:0@lo:400:kworker.0 00000100:00100000:1.0:1789545713.215918:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545713.215939:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454929280 00000100:00100000:1.0:1789545713.215943:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454929280 00000100:00100000:1.0:1789545713.215969:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789545713.215975:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454929280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545713.216008:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454929280:12345-0@lo:400:kworker.0 Request processed in 33us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545713.216012:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789545713.216037:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454929280:0@lo:400:kworker.0 00000100:00100000:1.0:1789545713.216056:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454929152:0@lo:400:kworker.0 00000100:00100000:1.0:1789545713.216066:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454929536:0@lo:400:kworker.0 00000100:00100000:1.0:1789545713.216089:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454929664 00000100:00100000:1.0:1789545713.216092:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454929664 00000100:00100000:1.0:1789545713.216122:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454929408 00000100:00100000:1.0:1789545713.216125:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454929408 00000100:00100000:1.0:1789545713.216143:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789545713.216148:0:8211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454929664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545713.216182:0:8211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454929664:12345-0@lo:400:kworker.0 Request processed in 34us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545713.216187:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789545713.216199:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789545713.216204:0:8211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454929408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545713.216231:0:8211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454929408:12345-0@lo:400:kworker.0 Request processed in 27us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545713.216236:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789545713.216264:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454929408:0@lo:400:kworker.0 00010000:00080000:1.0:1789545713.216284:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be4b3f100 x1876474454929664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545713.216305:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454929664:0@lo:400:kworker.0 00000100:00080000:3.0:1789545713.216561:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789545713.216566:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789545713.216568:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789545713.468579:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545713.724793:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454929792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789545713.724874:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545713.727099:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789545713.727119:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be5192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454929920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789545713.727191:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545713.727402:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454929792 00000100:00100000:2.0:1789545713.727411:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454929792 00000100:00100000:2.0:1789545713.727466:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454929920 00000100:00100000:2.0:1789545713.727470:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454929920 00000100:00100000:2.0:1789545713.727486:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789545713.727495:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454929792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789545713.727535:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789545713.727614:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454929792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (2738us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545713.727622:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789545713.727641:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789545713.727647:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454929920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789545713.727666:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789545713.727694:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454929920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545713.727701:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1789545713.728167:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be5192a00 x1876474454929920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545713.728187:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be5192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454929920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789545713.728206:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454929792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789545714.101107:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545714.101177:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545714.101213:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545714.101297:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438115712 00000100:00100000:3.0:1789545714.101308:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438115712 00000100:00100000:1.0:1789545714.101339:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438115584 00000100:00100000:1.0:1789545714.101347:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438115584 00000100:00100000:3.0:1789545714.101422:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 121 00000100:00100000:3.0:1789545714.101433:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2361:x1876474438115712:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545714.101475:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438115456 00000100:00100000:3.0:1789545714.101531:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2361:x1876474438115712:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 99us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545714.101624:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438115456 00000100:00100000:2.0:1789545714.101657:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 282 00000100:00100000:2.0:1789545714.101665:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2361:x1876474438115456:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545714.101695:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2361:x1876474438115456:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 31us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545714.101702:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 282 00000100:00100000:1.0:1789545714.102157:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 122 00000100:00100000:1.0:1789545714.102178:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be479ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+5:2361:x1876474438115584:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545714.102212:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be479ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+5:2361:x1876474438115584:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 47us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545714.102218:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 122 00000100:00080000:0.0:1789545714.104308:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789545714.108408:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 121 00010000:00010000:2.0:1789545714.495432:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545715.519574:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545716.544568:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789545716.677068:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789545717.564604:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789545718.316202:0:11860:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 04:01:57 (1789545717) 00000100:00100000:0.0:1789545718.343168:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be479b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454930048:0@lo:400:kworker.0 00000100:00100000:0.0:1789545718.343238:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545718.343285:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454930560:0@lo:400:kworker.0 00000100:00100000:0.0:1789545718.343324:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545718.343350:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789545718.343356:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be479b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454930176:0@lo:400:kworker.0 00000100:00100000:0.0:1789545718.343531:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545718.343550:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be479aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454930688:0@lo:400:kworker.0 00000100:00100000:0.0:1789545718.343585:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545718.343615:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454930304:0@lo:400:kworker.0 00000100:00100000:0.0:1789545718.343636:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545718.343653:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789545718.343658:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be479bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454930432:0@lo:400:kworker.0 00000100:00100000:0.0:1789545718.343676:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545718.343704:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454930048 00000100:00100000:0.0:1789545718.343712:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454930048 00000100:00100000:0.0:1789545718.343758:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789545718.343766:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454930048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545718.343811:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454930048:12345-0@lo:400:kworker.0 Request processed in 46us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545718.343827:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789545718.343858:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454930560 00000100:00100000:0.0:1789545718.343861:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454930560 00000100:00100000:0.0:1789545718.343892:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454930176 00000100:00100000:0.0:1789545718.343895:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454930176 00000100:00100000:0.0:1789545718.343908:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454930304 00000100:00100000:0.0:1789545718.343910:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454930304 00000100:00100000:0.0:1789545718.343924:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789545718.343929:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454930560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545718.344036:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454930560:12345-0@lo:400:kworker.0 Request processed in 106us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545718.344043:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789545718.344056:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789545718.344062:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454930176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545718.344089:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454930176:12345-0@lo:400:kworker.0 Request processed in 28us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545718.344095:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789545718.344106:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789545718.344111:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454930304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545718.344140:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454930304:12345-0@lo:400:kworker.0 Request processed in 29us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545718.344146:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789545718.344165:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454930688 00000100:00100000:0.0:1789545718.344169:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454930688 00000100:00100000:0.0:1789545718.344191:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454930432 00000100:00100000:0.0:1789545718.344194:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454930432 00000100:00100000:0.0:1789545718.344212:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789545718.344228:0:8211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454930688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545718.344258:0:8211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454930688:12345-0@lo:400:kworker.0 Request processed in 31us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545718.344263:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789545718.344274:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789545718.344280:0:8211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454930432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545718.344303:0:8211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454930432:12345-0@lo:400:kworker.0 Request processed in 24us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545718.344308:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789545718.344926:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be479b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454930176:0@lo:400:kworker.0 00010000:00080000:0.0:1789545718.345019:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be479aa00 x1876474454930688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789545734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545718.345031:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be479aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454930688:0@lo:400:kworker.0 00000100:00100000:0.0:1789545718.345044:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be479b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454930048:0@lo:400:kworker.0 00000100:00100000:0.0:1789545718.345054:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454930560:0@lo:400:kworker.0 00000100:00080000:0.0:1789545718.345096:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789545718.345100:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789545718.345104:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789545718.345120:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be479bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454930432:0@lo:400:kworker.0 00000100:00100000:0.0:1789545718.345131:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454930304:0@lo:400:kworker.0 00010000:00010000:2.0:1789545718.589259:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545718.845668:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789545718.845694:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454930816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789545718.845786:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545718.845867:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454930816 00000100:00100000:2.0:1789545718.845876:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454930816 00000100:00100000:2.0:1789545718.845931:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789545718.845940:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454930816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789545718.845974:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789545718.846031:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454930816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545718.846038:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789545718.846073:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454930816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789545718.847121:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454930944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789545718.847164:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545718.847344:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454930944 00000100:00100000:0.0:1789545718.847352:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454930944 00000100:00100000:0.0:1789545718.847431:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789545718.847442:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454930944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789545718.847469:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789545718.847531:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454930944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545718.847538:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1789545718.847611:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be54d1500 x1876474454930944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545734 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545718.847628:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454930944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789545719.219821:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545719.219870:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545719.219907:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545719.220007:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438116096 00000100:00100000:2.0:1789545719.220017:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438116096 00000100:00100000:2.0:1789545719.220093:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438115968 00000100:00100000:2.0:1789545719.220097:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438115968 00000100:00100000:2.0:1789545719.220119:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 126 00000100:00100000:2.0:1789545719.220128:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2358:x1876474438116096:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545719.220200:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2358:x1876474438116096:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 72us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545719.220208:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 126 00000100:00100000:2.0:1789545719.220225:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 127 00000100:00100000:2.0:1789545719.220232:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+5:2358:x1876474438115968:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545719.220258:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+5:2358:x1876474438115968:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 26us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545719.220264:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 127 00000100:00100000:1.0:1789545719.220580:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438115840 00000100:00100000:1.0:1789545719.220585:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438115840 00000100:00100000:1.0:1789545719.220620:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 284 00000100:00100000:1.0:1789545719.220629:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2358:x1876474438115840:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545719.220667:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2358:x1876474438115840:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 39us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545719.220683:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 284 00000100:00080000:3.0:1789545719.221001:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789545719.612624:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545720.562868:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545720.563034:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438116224 00000100:00100000:2.0:1789545720.563049:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438116224 00000100:00100000:2.0:1789545720.563166:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 32 00000100:00100000:2.0:1789545720.563179:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+5:10262:x1876474438116224:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789545720.563211:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545720.563241:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c086f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de541f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545720.563329:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c0876 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545720.563347:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c0876 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545720.563421:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c0876 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545720.563508:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789545720.563513:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789545720.563567:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c0876 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545720.563599:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c086f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de541f expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545720.563624:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c0876 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de541f expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545720.563634:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bcd248300) 00010000:00010000:2.0:1789545720.563637:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789545720.563642:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1e00, rc 0) 00000100:00100000:2.0:1789545720.563731:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+6:10262:x1876474438116224:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 555us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545720.563739:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 32 00000100:00100000:2.0:1789545720.580174:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545720.581504:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438116352 00000100:00100000:0.0:1789545720.581525:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438116352 00000100:00100000:0.0:1789545720.581618:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 33 00000100:00100000:0.0:1789545720.581631:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+6:10263:x1876474438116352:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789545720.581661:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545720.581688:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7600/0x64919c0f856c087d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5426 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.581779:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0884 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.581798:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0884 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.581812:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0884 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.581829:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c088b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.581836:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c088b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.581866:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c088b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.582152:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7a00/0x64919c0f856c0892 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.582161:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7a00/0x64919c0f856c0892 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.582170:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7a00/0x64919c0f856c0892 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789545720.582207:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789545720.582211:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789545720.582239:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7a00/0x64919c0f856c0892 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.582252:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0884 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.582259:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0884 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.582268:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0884 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.582275:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6800 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545720.582280:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0884 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.582289:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0884 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.582312:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bcd248300) 00010000:00010000:0.0:1789545720.582315:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545720.582322:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0884 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.582329:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0884 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.582346:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c088b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.582352:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c088b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.583145:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c088b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.583155:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb7c00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545720.583159:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c088b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.583167:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c088b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.583181:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff994bc4f11700) 00010000:00010000:0.0:1789545720.583184:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545720.583188:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c088b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.583195:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c088b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.583273:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7600/0x64919c0f856c087d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5426 expref: 8 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.583290:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7a00/0x64919c0f856c0892 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5426 expref: 7 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.583298:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff994bc4f11d00) 00010000:00010000:0.0:1789545720.583300:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789545720.583302:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb7a00, rc 0) 00000100:00100000:0.0:1789545720.583448:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+7:10263:x1876474438116352:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 1819us (3289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545720.583458:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 33 00000100:00100000:1.0:1789545720.587973:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545720.588438:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438116608 00000100:00100000:0.0:1789545720.588459:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438116608 00000100:00100000:0.0:1789545720.588557:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 34 00000100:00100000:0.0:1789545720.588571:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+7:10263:x1876474438116608:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789545720.588600:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545720.588637:0:10125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0899 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de542d expref: -99 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.588742:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c08a0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.588761:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c08a0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.588777:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c08a0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.588946:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c08a7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.588968:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c08a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.588982:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c08a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.589859:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7600/0x64919c0f856c08ae lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.589873:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7600/0x64919c0f856c08ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.589881:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7600/0x64919c0f856c08ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789545720.589895:0:10125:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789545720.590043:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c08a0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.590643:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c08a0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.590657:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c08a0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.590663:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6600 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545720.590668:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c08a0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.590690:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c08a0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.590706:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff994bc4f11d00) 00010000:00010000:0.0:1789545720.590709:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545720.590714:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c08a0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.590720:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c08a0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.590733:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c08a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.590738:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c08a7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.590745:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c08a7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.590751:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545720.590754:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c08a7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.590759:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c08a7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.590766:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff994bc4f11100) 00010000:00010000:0.0:1789545720.590768:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545720.590770:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c08a7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.590785:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c08a7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.591976:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0899 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de542d expref: 10 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.592002:0:10125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7600/0x64919c0f856c08ae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de542d expref: 9 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545720.592011:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff994bc4f11700) 00010000:00010000:0.0:1789545720.592014:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545720.592017:0:10125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb7600, rc 0) 00000100:00100000:0.0:1789545720.592347:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+9:10263:x1876474438116608:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 3777us (4382us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789545720.592458:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 34 00000100:00100000:1.0:1789545720.598005:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545720.598097:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438116736 00000100:00100000:3.0:1789545720.598108:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438116736 00000100:00100000:3.0:1789545720.598167:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 35 00000100:00100000:3.0:1789545720.598177:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+9:10263:x1876474438116736:12345-192.168.201.16@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789545720.598287:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+9:10263:x1876474438116736:12345-192.168.201.16@tcp:59:lhsmtool_posix.0 Request processed in 111us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545720.598294:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 35 00010000:00010000:2.0:1789545720.637045:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789545720.767244:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789545721.661660:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545722.690737:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789545722.786450:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545722.786500:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438116864 00000100:00100000:3.0:1789545722.786513:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438116864 00000100:00080000:2.0:1789545722.787151:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789545722.787190:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 36 00000100:00100000:2.0:1789545722.787205:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+9:10305:x1876474438116864:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:2.0:1789545722.787236:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545722.787264:0:10125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c08bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5434 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.787394:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c08c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.787412:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c08c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.787426:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c08c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.787457:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c08ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.787464:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c08ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.787471:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c08ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.787749:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c08c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.787760:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c08c3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.787769:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c08c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.787777:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0c00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545722.787783:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c08c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.787803:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c08c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.787820:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bcd248300) 00010000:00010000:2.0:1789545722.787824:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545722.787831:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c08c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.787839:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c08c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.787853:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c08ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.787860:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c08ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.787866:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c08ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.787872:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545722.787876:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c08ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.787882:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c08ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.787890:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff994bcd248200) 00010000:00010000:2.0:1789545722.787893:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545722.787896:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c08ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.787912:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c08ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.787958:0:10125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c08bc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5434 expref: 10 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.787971:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bcd248300) 00010000:00010000:2.0:1789545722.787973:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545722.787978:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c08bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5434 expref: 10 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.787988:0:10125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1600, rc 0) 00000100:00100000:2.0:1789545722.788094:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+9:10305:x1876474438116864:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 893us (1671us total) trans 0 rc 301/301 00000100:00100000:2.0:1789545722.788103:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 36 00000100:00100000:1.0:1789545722.810059:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545722.812180:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438117120 00000100:00100000:2.0:1789545722.812202:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438117120 00000100:00100000:2.0:1789545722.812297:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 37 00000100:00100000:2.0:1789545722.812310:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+9:10305:x1876474438117120:12345-192.168.201.16@tcp:36:lfs.0 00010000:00010000:2.0:1789545722.812407:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545722.812476:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c0876 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de541f expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.812502:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bcd248300) 00010000:00010000:2.0:1789545722.812517:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789545722.812820:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c08d1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.812844:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c08d1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.812855:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c08d1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.812868:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c08d8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.812875:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c08d8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.812881:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c08d8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545722.819213:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789545722.819244:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c08d1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.819257:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c08d1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.819267:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c08d1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.819274:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1c00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545722.819280:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c08d1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.819289:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c08d1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.819322:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bcd248b00) 00010000:00010000:2.0:1789545722.819325:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545722.819332:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c08d1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.819345:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c08d1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789545722.819694:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e44a4a4 reply state 00000000c55c6042 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c08d8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545722.819705:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789545722.824725:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+10:10305:x1876474438117120:12345-192.168.201.16@tcp:36:lfs.0 Request processed in 12399us (21843us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789545722.824742:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 37 00010000:00010000:0.0:1789545722.829159:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c08d8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.829184:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c08d8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.829193:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c08d8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.829201:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545722.829207:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c08d8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.829230:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c08d8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.829252:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff994bcd248000) 00010000:00010000:0.0:1789545722.829255:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545722.829262:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c08d8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.829268:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c08d8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545722.921089:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545722.921266:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438117248 00000100:00100000:2.0:1789545722.921281:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438117248 00000100:00100000:2.0:1789545722.921410:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 38 00000100:00100000:2.0:1789545722.921423:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+9:10313:x1876474438117248:12345-192.168.201.16@tcp:101:lctl.0 00010000:00010000:2.0:1789545722.921466:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545722.921498:0:10125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c08df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de543b expref: -99 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.921656:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c08e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.921677:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c08e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.921691:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c08e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545722.921740:0:10125:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789545722.921763:0:10125:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789545722.921813:0:10125:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c08e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.921846:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c08df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de543b expref: 11 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.921868:0:10125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c08e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de543b expref: 10 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.921878:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bcd248b00) 00010000:00010000:2.0:1789545722.921881:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789545722.921886:0:10125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1e00, rc 0) 00000100:00100000:2.0:1789545722.921963:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+10:10313:x1876474438117248:12345-192.168.201.16@tcp:101:lctl.0 Request processed in 542us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545722.921972:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 38 00000100:00100000:1.0:1789545722.982944:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545722.983210:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438117376 00000100:00100000:0.0:1789545722.983224:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438117376 00000100:00100000:0.0:1789545722.983305:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 39 00000100:00100000:0.0:1789545722.983318:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+10:10319:x1876474438117376:12345-192.168.201.16@tcp:101:bash.0 00010000:00010000:0.0:1789545722.983347:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545722.983439:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c08ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5442 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.983531:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c08f4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.983548:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c08f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.983562:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c08f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.983593:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c08fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.983622:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c08fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.983630:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c08fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.983765:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7e00/0x64919c0f856c0902 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.983774:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7e00/0x64919c0f856c0902 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.983781:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7e00/0x64919c0f856c0902 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789545722.983823:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789545722.983829:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789545722.983884:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7e00/0x64919c0f856c0902 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.983899:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c08f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.983907:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c08f4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.983914:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c08f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.983920:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb7800 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545722.983925:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c08f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.983941:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c08f4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.983957:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bcd248b00) 00010000:00010000:0.0:1789545722.983960:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545722.983967:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c08f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.983974:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c08f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.983990:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c08fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.983996:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c08fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.984002:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c08fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.984007:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb7400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545722.984196:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c08fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.984203:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c08fb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.984211:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff994bc4f11100) 00010000:00010000:0.0:1789545722.984214:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545722.984218:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c08fb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.984235:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c08fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.984275:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c08ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5442 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.984290:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7e00/0x64919c0f856c0902 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5442 expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545722.984298:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:0.0:1789545722.984300:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789545722.984303:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb7e00, rc 0) 00000100:00100000:0.0:1789545722.984685:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+11:10319:x1876474438117376:12345-192.168.201.16@tcp:101:bash.0 Request processed in 1367us (1755us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545722.984694:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 39 00000100:00100000:0.0:1789545722.990024:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545722.990183:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438117632 00000100:00100000:2.0:1789545722.990196:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438117632 00000100:00100000:2.0:1789545722.990275:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 40 00000100:00100000:2.0:1789545722.990288:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+11:10319:x1876474438117632:12345-192.168.201.16@tcp:101:bash.0 00010000:00010000:2.0:1789545722.990317:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545722.990343:0:10125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c0909 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5449 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.990571:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0910 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.990600:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0910 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.990636:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0910 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.994094:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0917 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.994119:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.994134:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789545722.995697:0:10125:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1789545722.997616:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c091e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.997640:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c091e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.997656:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c091e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.997712:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0910 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.997720:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0910 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.997727:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0910 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.997734:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545722.997751:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0910 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.997760:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0910 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.997773:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:2.0:1789545722.997777:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545722.997782:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0910 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.997789:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0910 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789545722.997806:0:10125:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067ab0d39 reply state 000000001e8e4ca5 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545722.997814:0:10125:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789545722.997858:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c0909 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5449 expref: 14 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.997886:0:10125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c091e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5449 expref: 13 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545722.997894:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bcd248200) 00010000:00010000:2.0:1789545722.997897:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789545722.997899:0:10125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0a00, rc 0) 00000100:00100000:2.0:1789545722.999481:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+14:10319:x1876474438117632:12345-192.168.201.16@tcp:101:bash.0 Request processed in 9189us (9475us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789545722.999496:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 40 00010000:00010000:0.0:1789545723.005132:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.005159:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0917 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.005169:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0917 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.005175:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0c00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545723.005181:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0917 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.005212:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0917 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.005234:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff994bcd248300) 00010000:00010000:0.0:1789545723.005237:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545723.005243:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0917 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.005249:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0917 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545723.006448:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545723.006686:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438117760 00000100:00100000:3.0:1789545723.006700:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438117760 00000100:00100000:3.0:1789545723.006766:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 20 00000100:00100000:3.0:1789545723.006791:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1876474438117760:12345-192.168.201.16@tcp:8:bash.0 00010000:00080000:3.0:1789545723.006836:0:6692:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 8a8edb7a-f384-4468-93f4-9d664f284862@192.168.201.16@tcp t0 exp 0000000000000000 cur 336 last 0 00000020:00000080:3.0:1789545723.006879:0:6692:0:(genops.c:1384:class_connect()) connect: client 8a8edb7a-f384-4468-93f4-9d664f284862, cookie 0x64919c0f856c092c 00002000:00100000:3.0:1789545723.006894:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8a8edb7a-f384-4468-93f4-9d664f284862/ffff994bc2bc4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789545723.006925:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789545723.007246:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789545723.007286:0:6692:0:(import.c:65:import_set_state_nolock()) ffff994bc2bc1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789545723.007411:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a8edb7a-f384-4468-93f4-9d664f284862+6:2357:x1876474438117760:12345-192.168.201.16@tcp:8:bash.0 Request processed in 619us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545723.007419:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 20 00000100:00100000:2.0:1789545723.012097:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545723.012188:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438117888 00000100:00100000:0.0:1789545723.012200:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438117888 00000100:00100000:0.0:1789545723.012283:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 21 00000100:00100000:0.0:1789545723.012296:0:8211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a8edb7a-f384-4468-93f4-9d664f284862+6:0:x1876474438117888:12345-192.168.201.16@tcp:101:bash.0 00010000:00010000:0.0:1789545723.012320:0:8211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545723.012350:0:8211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000428904bd/0x64919c0f856c0933 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5450 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789545723.012422:0:8211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789545723.012483:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=336s v=(0 0) 00010000:00010000:0.0:1789545723.012488:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789545723.012500:0:8211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000428904bd/0x64919c0f856c0933 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5450 expref: 7 pid: 8211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.012525:0:8211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000428904bd/0x64919c0f856c0933 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5450 expref: 7 pid: 8211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.012559:0:8211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb6200, rc 0) 00000100:00100000:0.0:1789545723.012628:0:8211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a8edb7a-f384-4468-93f4-9d664f284862+7:0:x1876474438117888:12345-192.168.201.16@tcp:101:bash.0 Request processed in 334us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545723.012636:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 21 00000100:00080000:2.0:1789545723.012874:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789545723.015720:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545723.015834:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438118016 00000100:00100000:3.0:1789545723.015848:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438118016 00000100:00100000:3.0:1789545723.015933:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 22 00000100:00100000:3.0:1789545723.015947:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a8edb7a-f384-4468-93f4-9d664f284862+7:10319:x1876474438118016:12345-192.168.201.16@tcp:101:bash.0 00010000:00010000:3.0:1789545723.016155:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545723.016188:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c093a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5457 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545723.016232:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000428904bd/0x64919c0f856c0933 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5450 expref: 8 pid: 8211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545723.016242:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789545723.016247:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789545723.016253:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c093a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5457 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545723.016320:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000428904bd/0x64919c0f856c0933 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5450 expref: 8 pid: 8211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545723.016337:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000428904bd/0x64919c0f856c0933 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5450 expref: 8 pid: 8211 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545723.016354:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb40a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1876474454931072:192.168.201.16@tcp:104: 00000100:00100000:2.0:1789545723.016718:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc12ed780 going to sleep for 11 seconds 00000100:00100000:2.0:1789545723.028138:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb40a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1876474454931072:192.168.201.16@tcp:104: 00010000:00010000:2.0:1789545723.028199:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c093a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5457 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.028238:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217f000, rc 0) 00000100:00100000:2.0:1789545723.028335:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a8edb7a-f384-4468-93f4-9d664f284862+8:10319:x1876474438118016:12345-192.168.201.16@tcp:101:bash.0 Request processed in 12391us (12628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545723.028346:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 22 00000100:00100000:1.0:1789545723.029927:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545723.030879:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438118144 00000100:00100000:2.0:1789545723.030894:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438118144 00010000:00010000:2.0:1789545723.030952:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000428904bd/0x64919c0f856c0933 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5450 expref: 8 pid: 8211 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545723.031079:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 35 00000100:00100000:2.0:1789545723.031093:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5192a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+8:2358:x1876474438118144:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789545723.031114:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545723.031144:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000428904bd/0x64919c0f856c0933 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5450 expref: 8 pid: 8211 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.031162:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000428904bd/0x64919c0f856c0933 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5450 expref: 8 pid: 8211 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.031194:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000428904bd/0x64919c0f856c0933 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5450 expref: 8 pid: 8211 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.031248:0:7637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545723.031253:0:7637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545723.031263:0:7637:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c093a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5457 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.031275:0:7637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c093a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5457 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.031325:0:7637:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c093a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5457 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545723.031341:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7637:1876474454931200:192.168.201.16@tcp:105: 00000100:00100000:2.0:1789545723.031524:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfadc540 going to sleep for 11 seconds 00000100:00100000:3.0:1789545723.036224:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7637:1876474454931200:192.168.201.16@tcp:105: 00010000:00010000:3.0:1789545723.036281:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545723.036382:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5192a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+7:2358:x1876474438118144:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5265us (6437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545723.036397:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 35 00000100:00100000:3.0:1789545723.039847:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545723.040026:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438118400 00000100:00100000:2.0:1789545723.040040:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438118400 00000100:00100000:2.0:1789545723.040115:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 6 00000100:00100000:2.0:1789545723.040128:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+13:10319:x1876474438118400:12345-192.168.201.16@tcp:35:bash.0 00000100:00100000:2.0:1789545723.040652:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+14:10319:x1876474438118400:12345-192.168.201.16@tcp:35:bash.0 Request processed in 524us (815us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789545723.040661:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 6 00000100:00100000:1.0:1789545723.143521:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545723.143683:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438118656 00000100:00100000:3.0:1789545723.143698:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438118656 00000100:00100000:3.0:1789545723.143901:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 41 00000100:00100000:3.0:1789545723.143914:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf4ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+14:10329:x1876474438118656:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:3.0:1789545723.143946:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545723.143973:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0941 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de545e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545723.144103:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789545723.144260:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0941 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de545e expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545723.144291:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bcd248b00) 00010000:00010000:3.0:1789545723.144295:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789545723.144302:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0941 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de545e expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545723.144321:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217f400, rc 0) 00000100:00100000:3.0:1789545723.144535:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf4ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+15:10329:x1876474438118656:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 623us (1028us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1789545723.144544:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 41 00000100:00100000:1.0:1789545723.152979:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545723.153266:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438118912 00000100:00100000:2.0:1789545723.153283:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438118912 00000100:00100000:2.0:1789545723.153404:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7 00000100:00100000:2.0:1789545723.153418:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf4ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+15:10329:x1876474438118912:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:2.0:1789545723.153960:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf4ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+16:10329:x1876474438118912:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 543us (1003us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789545723.153970:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7 00000100:00100000:1.0:1789545723.213156:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545723.213218:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438119040 00000100:00100000:3.0:1789545723.213275:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438119040 00000100:00100000:3.0:1789545723.213341:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 42 00000100:00100000:3.0:1789545723.213352:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+16:10335:x1876474438119040:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:3.0:1789545723.213415:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545723.213567:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c094f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5465 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.213649:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0956 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.213663:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0956 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.213675:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0956 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789545723.213716:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789545723.213719:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789545723.213740:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0956 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.213765:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c094f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5465 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.213783:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0956 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5465 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.213791:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:0.0:1789545723.213809:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789545723.213813:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb7400, rc 0) 00000100:00100000:0.0:1789545723.213896:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+17:10335:x1876474438119040:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 546us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545723.213903:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 42 00000100:00100000:1.0:1789545723.216979:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545723.217118:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438119296 00000100:00100000:0.0:1789545723.217130:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438119296 00000100:00100000:0.0:1789545723.217188:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 43 00000100:00100000:0.0:1789545723.217197:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+17:10335:x1876474438119296:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:0.0:1789545723.217220:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545723.217243:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c095d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de546c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.217383:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0964 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.217398:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.217408:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789545723.217420:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789545723.217586:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c095d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de546c expref: 20 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.217602:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0964 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de546c expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.217626:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bcd248200) 00010000:00010000:0.0:1789545723.217629:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789545723.217631:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb7000, rc 0) 00000100:00100000:0.0:1789545723.217695:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+19:10335:x1876474438119296:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 499us (731us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789545723.217701:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 43 00000100:00100000:1.0:1789545723.219851:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545723.219917:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438119424 00000100:00100000:2.0:1789545723.219930:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438119424 00000100:00100000:2.0:1789545723.220131:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2 00000100:00100000:2.0:1789545723.220146:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf4ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+19:2359:x1876474438119424:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789545723.220167:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545723.220201:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0964 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de546c expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.220222:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bcd248200) 00010000:00010000:2.0:1789545723.220228:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789545723.220349:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf4ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+18:2359:x1876474438119424:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 207us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545723.220397:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2 00000100:00100000:1.0:1789545723.220991:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545723.221150:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438119680 00000100:00100000:2.0:1789545723.221158:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438119680 00000100:00100000:2.0:1789545723.221207:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 44 00000100:00100000:2.0:1789545723.221217:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf4ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+18:10335:x1876474438119680:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:2.0:1789545723.221247:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545723.221268:0:10125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c0972 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5473 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.221429:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0979 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.221469:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0979 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.221483:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0979 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545723.221500:0:10125:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789545723.221661:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c0972 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5473 expref: 21 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.221676:0:10125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0979 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5473 expref: 20 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.221682:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bcd248200) 00010000:00010000:2.0:1789545723.221685:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789545723.221687:0:10125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1200, rc 0) 00000100:00100000:2.0:1789545723.221737:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf4ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+20:10335:x1876474438119680:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 523us (749us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789545723.221742:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 44 00000100:00100000:1.0:1789545723.225420:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545723.225541:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438119808 00000100:00100000:0.0:1789545723.225553:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438119808 00000100:00100000:0.0:1789545723.225607:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 23 00000100:00100000:0.0:1789545723.225615:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+7:2361:x1876474438119808:12345-192.168.201.16@tcp:1:lfs.0 00010000:00010000:0.0:1789545723.225671:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000428904bd/0x64919c0f856c0987 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.225690:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c093a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5457 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.225698:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789545723.225702:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789545723.225706:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000428904bd/0x64919c0f856c0987 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.225745:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c093a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5457 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.225758:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c093a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5457 expref: 7 pid: 6692 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545723.225794:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be76d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6693:1876474454931328:192.168.201.16@tcp:104: 00000100:00100000:0.0:1789545723.225896:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdf604600 going to sleep for 11 seconds 00000100:00100000:3.0:1789545723.229332:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545723.229645:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be76d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6693:1876474454931328:192.168.201.16@tcp:104: 00010000:00010000:0.0:1789545723.229691:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000428904bd/0x64919c0f856c0987 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545723.230033:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438119936 00000100:00100000:2.0:1789545723.230047:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438119936 00002000:00100000:2.0:1789545723.230101:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff994bdfb43100 x1876474438119936/t0(0) o4->8a8edb7a-f384-4468-93f4-9d664f284862@192.168.201.16@tcp:189/0 lens 504/0 e 0 to 0 dl 1789545734 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789545723.230113:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994bdfb43100 with x1876474438119936 ext(0->12) 00010000:00010000:2.0:1789545723.230123:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c093a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5457 expref: 8 pid: 6692 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.230216:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c093a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5457 expref: 8 pid: 6692 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789545723.230226:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff994bdfb43100 00000100:00100000:2.0:1789545723.230332:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 0 00000100:00100000:2.0:1789545723.230343:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8a8edb7a-f384-4468-93f4-9d664f284862+8:2358:x1876474438119936:12345-192.168.201.16@tcp:4:lfs.0 00000001:00100000:1.0:1789545723.271993:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8a8edb7a-f384-4468-93f4-9d664f284862 00000100:00100000:2.0:1789545723.272796:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8a8edb7a-f384-4468-93f4-9d664f284862+9:2358:x1876474438119936:12345-192.168.201.16@tcp:4:lfs.0 Request processed in 42447us (43465us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789545723.272810:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 0 00002000:00100000:2.0:1789545723.272829:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff994bdfb43100 x1876474438119936/t4294967299(0) o4->8a8edb7a-f384-4468-93f4-9d664f284862@192.168.201.16@tcp:189/0 lens 504/448 e 0 to 0 dl 1789545734 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789545723.272841:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994bdfb43100 with x1876474438119936 ext(0->12) 00010000:00010000:2.0:1789545723.272854:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c093a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5457 expref: 9 pid: 6692 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.272876:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c093a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5457 expref: 9 pid: 6692 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789545723.272885:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff994bdfb43100 00000100:00100000:2.0:1789545723.278803:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545723.278914:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438120064 00000100:00100000:0.0:1789545723.278928:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438120064 00010000:00010000:0.0:1789545723.278993:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c093a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5457 expref: 9 pid: 6692 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545723.279099:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 36 00000100:00100000:0.0:1789545723.279112:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a8edb7a-f384-4468-93f4-9d664f284862+9:2360:x1876474438120064:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789545723.279134:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789545723.279161:0:7636:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789545723.279164:0:7636:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789545723 00002000:00010000:0.0:1789545723.279167:0:7636:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789545723 00002000:00010000:0.0:1789545723.279169:0:7636:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789545723 00010000:00010000:0.0:1789545723.279176:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c093a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5457 expref: 9 pid: 6692 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.279194:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c093a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5457 expref: 9 pid: 6692 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.279247:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c093a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5457 expref: 9 pid: 6692 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.279269:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789545723.279274:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789545723.279281:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000428904bd/0x64919c0f856c0987 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.279293:0:7636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000428904bd/0x64919c0f856c0987 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.279492:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789545723.279527:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000428904bd/0x64919c0f856c0987 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.279539:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000428904bd/0x64919c0f856c0987 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.279580:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000428904bd/0x64919c0f856c0987 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.279591:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000428904bd/0x64919c0f856c0987 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.279611:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000428904bd/0x64919c0f856c0987 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.279620:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6200 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:1.0:1789545723.279625:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000428904bd/0x64919c0f856c0987 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.279636:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000428904bd/0x64919c0f856c0987 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.279653:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000428904bd/0x64919c0f856c0987 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545723.279655:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a8edb7a-f384-4468-93f4-9d664f284862+8:2360:x1876474438120064:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 544us (868us total) trans 0 rc 0/0 00010000:00010000:1.0:1789545723.279662:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000428904bd/0x64919c0f856c0987 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545723.279665:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 36 00000100:00100000:1.0:1789545723.279724:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+7:2361:x1876474438119808:12345-192.168.201.16@tcp:1:lfs.0 Request processed in 54108us (54317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545723.279732:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 23 00000100:00100000:1.0:1789545723.282295:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545723.282483:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438120320 00000100:00100000:3.0:1789545723.282502:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438120320 00000100:00100000:3.0:1789545723.282942:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8 00000100:00100000:3.0:1789545723.282953:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf4ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+20:10335:x1876474438120320:12345-192.168.201.16@tcp:35:lfs.0 00000004:00010000:3.0:1789545723.283044:0:5850:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0979 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5473 expref: 20 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789545723.283475:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1789545723.283542:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1789545723.284178:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1789545723.284245:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c098e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545723.284265:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c091e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5449 expref: 24 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545723.284277:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c098e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545723.284320:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c091e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5449 expref: 24 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545723.284334:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c091e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5449 expref: 24 pid: 10125 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545723.284347:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb41f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5850:1876474454931456:192.168.201.16@tcp:104: 00000100:00100000:3.0:1789545723.284507:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff994be75f0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789545723.288560:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545723.288828:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb41f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5850:1876474454931456:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545723.288860:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c098e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545723.288914:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438120448 00000100:00100000:0.0:1789545723.288923:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438120448 00010000:00010000:0.0:1789545723.289037:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c091e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5449 expref: 25 pid: 10125 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545723.289087:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 37 00000100:00100000:0.0:1789545723.289100:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+25:2358:x1876474438120448:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789545723.289119:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789545723.289128:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c091e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5449 expref: 25 pid: 10125 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.289167:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c091e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5449 expref: 25 pid: 10125 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.289196:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c091e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5449 expref: 25 pid: 10125 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.289211:0:7637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bcd248200) 00010000:00010000:0.0:1789545723.289215:0:7637:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c098e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.289224:0:7637:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c098e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.289233:0:7637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c098e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.289300:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789545723.289400:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+24:2358:x1876474438120448:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 260us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545723.289410:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 37 00010000:00010000:3.0:1789545723.289539:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c098e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545723.289625:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c098e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789545723.289797:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1789545723.291546:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1789545723.291848:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb41f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1876474454931584:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789545723.298375:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545723.298445:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff994be75f0240 going to sleep for 11 seconds 00000100:00100000:2.0:1789545723.298561:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454931584 00000100:00100000:2.0:1789545723.298579:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454931584 00000100:00100000:2.0:1789545723.298674:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789545723.298702:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1876474454931584:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789545723.298864:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1876474454931584:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 164us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545723.298873:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789545723.299176:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb41f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1876474454931584:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789545723.301685:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1789545723.301802:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf4edc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1876474454931712:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789545723.301873:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545723.301924:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfc40300 going to sleep for 11 seconds 00000100:00100000:2.0:1789545723.301942:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454931712 00000100:00100000:2.0:1789545723.301956:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454931712 00000100:00100000:2.0:1789545723.302030:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789545723.302049:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf4ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1876474454931712:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789545723.302353:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf4ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1876474454931712:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 314us (479us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789545723.302379:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789545723.302480:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf4edc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1876474454931712:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789545723.302540:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1789545723.302585:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c098e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.302656:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c098e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.302665:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c098e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.302671:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217f400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545723.302676:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c098e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.302685:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c098e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.302701:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bcd248200) 00010000:00010000:1.0:1789545723.302704:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789545723.302709:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c098e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.302716:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c098e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789545723.302906:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789545723.303354:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1789545723.303445:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 337226084662ns, next at 338226081439ns, rc = 0 00000001:00080000:1.0:1789545723.303452:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1789545723.303501:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bcd248200) 00010000:00010000:1.0:1789545723.303504:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789545723.303512:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0979 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5473 expref: 28 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545723.303967:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf4ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+27:10335:x1876474438120320:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 21013us (21680us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1789545723.303978:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8 00000020:00080000:1.0:1789545723.303984:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:0.0:1789545723.304791:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789545723.309610:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545723.309705:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438120576 00000100:00100000:1.0:1789545723.309720:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438120576 00000100:00100000:1.0:1789545723.309815:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 45 00000100:00100000:1.0:1789545723.309826:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+27:10335:x1876474438120576:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:1.0:1789545723.309858:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545723.310020:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c0995 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de547a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.310101:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c0995 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de547a expref: 28 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.310116:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c0995 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de547a expref: 28 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.310135:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe600) 00010000:00010000:1.0:1789545723.310138:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789545723.310141:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba9000, rc 0) 00000100:00100000:1.0:1789545723.310255:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+28:10335:x1876474438120576:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 430us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545723.310280:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 45 00000100:00100000:0.0:1789545723.315591:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545723.322642:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438120832 00000100:00100000:2.0:1789545723.322663:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438120832 00000100:00100000:2.0:1789545723.322751:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9 00000100:00100000:2.0:1789545723.322771:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8cc7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+28:10335:x1876474438120832:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:2.0:1789545723.323100:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8cc7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+29:10335:x1876474438120832:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 332us (7525us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1789545723.323106:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9 00000100:00100000:3.0:1789545723.430063:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545723.430163:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438121088 00000100:00100000:2.0:1789545723.430177:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438121088 00000100:00100000:2.0:1789545723.430253:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 46 00000100:00100000:2.0:1789545723.430276:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+29:10345:x1876474438121088:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:2.0:1789545723.430310:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545723.430336:0:10125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c099c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5481 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545723.431073:0:10125:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789545723.431238:0:10125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c099c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5481 expref: 31 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.431256:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bcd248b00) 00010000:00010000:2.0:1789545723.431259:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789545723.431265:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c099c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5481 expref: 31 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.431283:0:10125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0000, rc 0) 00000100:00100000:2.0:1789545723.431455:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+30:10345:x1876474438121088:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 1192us (1406us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1789545723.431465:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 46 00000100:00100000:3.0:1789545723.442716:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545723.444844:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438121216 00000100:00100000:0.0:1789545723.444867:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438121216 00000100:00100000:0.0:1789545723.444965:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 47 00000100:00100000:0.0:1789545723.444979:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+30:10345:x1876474438121216:12345-192.168.201.16@tcp:34:lfs.0 00010000:00010000:0.0:1789545723.445091:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c09aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.445131:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c09aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.445147:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c09aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.445170:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c09b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.445179:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c09b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.445186:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c09b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.445306:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c09b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.445315:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c09b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.445323:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c09b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789545723.445443:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c09b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.445460:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c09aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.445468:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c09aa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.445489:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c09aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.445497:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb7200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545723.445503:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c09aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.445512:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c09aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.445527:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:0.0:1789545723.445531:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545723.445538:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c09aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.445546:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c09aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.445562:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c09b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.445569:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c09b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.445575:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c09b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.445580:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545723.445584:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c09b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.445603:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c09b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.445611:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff994bc4f11900) 00010000:00010000:0.0:1789545723.445614:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545723.445616:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c09b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.445622:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c09b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.445640:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c09b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.446791:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c09b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.446806:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c09b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.446814:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6600 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545723.446820:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c09b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.446830:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c09b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.446851:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe600) 00010000:00010000:0.0:1789545723.446855:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545723.446860:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c09b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.446886:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c09b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545723.447009:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+30:10345:x1876474438121216:12345-192.168.201.16@tcp:34:lfs.0 Request processed in 2028us (4304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545723.447020:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 47 00000100:00100000:0.0:1789545723.449348:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545723.449457:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438121472 00000100:00100000:1.0:1789545723.449472:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438121472 00000100:00100000:1.0:1789545723.449553:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10 00000100:00100000:1.0:1789545723.449563:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+30:10345:x1876474438121472:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:1.0:1789545723.449804:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+31:10345:x1876474438121472:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 241us (468us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1789545723.449813:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10 00000100:00100000:0.0:1789545723.453052:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be76d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454932096:0@lo:400:kworker.0 00000100:00100000:1.0:1789545723.453124:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be76d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454931840:0@lo:400:kworker.0 00000100:00100000:0.0:1789545723.453151:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545723.453213:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454932096 00000100:00100000:3.0:1789545723.453223:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454932096 00000100:00100000:3.0:1789545723.453289:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789545723.453301:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454932096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545723.453427:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be76d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876474454931968:0@lo:400:kworker.0 00000100:00100000:0.0:1789545723.454011:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789545723.454024:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be76d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454932224:0@lo:400:kworker.0 00000100:00100000:0.0:1789545723.454070:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789545723.454116:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789545723.454134:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454932224 00000100:00100000:0.0:1789545723.454142:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454932224 00000100:00100000:0.0:1789545723.454198:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789545723.454208:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454932224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545723.455626:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454932096:12345-0@lo:400:kworker.0 Request processed in 2322us (2470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545723.455640:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789545723.455864:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545723.455926:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be76d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454932352:0@lo:400:kworker.0 00000100:00100000:0.0:1789545723.455944:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454932224:12345-0@lo:400:kworker.0 Request processed in 1732us (1868us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545723.455957:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1789545723.456002:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789545723.456051:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be76d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454932224:0@lo:400:kworker.0 00000100:00100000:0.0:1789545723.456067:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be76d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454932096:0@lo:400:kworker.0 00000100:00100000:1.0:1789545723.456274:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545723.456390:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454931840 00000100:00100000:3.0:1789545723.456397:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454931840 00000100:00100000:3.0:1789545723.456442:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1789545723.456450:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454931840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545723.456497:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454931840:12345-0@lo:400:kworker.0 Request processed in 48us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545723.456502:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789545723.456597:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be76d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454931840:0@lo:400:kworker.0 00000100:00100000:2.0:1789545723.456701:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545723.456868:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454932352 00000100:00100000:1.0:1789545723.456872:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454932352 00000100:00100000:1.0:1789545723.456917:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454931968 00000100:00100000:1.0:1789545723.456920:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454931968 00000100:00100000:1.0:1789545723.456939:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789545723.456946:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf4eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454932352:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789545723.457163:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789545723.457186:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789545723.457193:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876474454931968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545723.457240:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876474454931968:12345-0@lo:400:kworker.0 Request processed in 48us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545723.457246:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789545723.457672:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf4eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454932352:12345-0@lo:400:kworker.0 Request processed in 726us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545723.457680:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789545723.457756:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be76d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876474454931968:0@lo:400:kworker.0 00000100:00100000:0.0:1789545723.457820:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be76d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454932352:0@lo:400:kworker.0 00000100:00100000:3.0:1789545723.489093:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545723.490205:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438121728 00000100:00100000:2.0:1789545723.490219:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438121728 00000100:00100000:2.0:1789545723.490502:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 48 00000100:00100000:2.0:1789545723.490514:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+31:10348:x1876474438121728:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:2.0:1789545723.490549:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545723.490569:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c09bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5488 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.491445:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c09c6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.491464:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c09c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.491477:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c09c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.491494:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c09cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.491502:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c09cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.491509:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c09cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.492223:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c09d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.492235:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c09d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.492484:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c09d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545723.492500:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789545723.493235:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c09c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.493905:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c09c6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.493913:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c09c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.493920:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545723.493925:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c09c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.493933:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c09c6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.493947:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:2.0:1789545723.493950:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545723.493956:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c09c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.493963:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c09c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.493980:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c09cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.493986:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c09cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.493992:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c09cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.494012:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545723.494015:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c09cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.494020:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c09cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.494028:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff994bcd248800) 00010000:00010000:2.0:1789545723.494030:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545723.494033:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c09cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.494038:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c09cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.494094:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c09bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5488 expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.495579:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c09d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5488 expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.495807:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe600) 00010000:00010000:2.0:1789545723.495810:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789545723.495814:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0a00, rc 0) 00000100:00100000:2.0:1789545723.496008:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+33:10348:x1876474438121728:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 5495us (6924us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1789545723.496018:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 48 00000100:00100000:3.0:1789545723.504449:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545723.504774:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438121856 00000100:00100000:0.0:1789545723.504807:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438121856 00000100:00100000:0.0:1789545723.504894:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 49 00000100:00100000:0.0:1789545723.504906:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+33:10348:x1876474438121856:12345-192.168.201.16@tcp:54:lfs.0 00010000:00010000:0.0:1789545723.504979:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c09e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.504998:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c09e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.505011:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c09e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.505037:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c09e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.505043:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c09e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.505050:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c09e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.505055:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545723.505060:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c09e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.505067:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c09e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.505078:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe600) 00010000:00010000:0.0:1789545723.505081:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789545723.505085:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c09e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545723.505113:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c09e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545723.505207:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+33:10348:x1876474438121856:12345-192.168.201.16@tcp:54:lfs.0 Request processed in 301us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545723.505214:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 49 00000100:00100000:0.0:1789545723.510483:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545723.510616:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438122112 00000100:00100000:1.0:1789545723.510627:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438122112 00000100:00100000:1.0:1789545723.510693:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11 00000100:00100000:1.0:1789545723.510717:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+33:10348:x1876474438122112:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:1.0:1789545723.511243:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+34:10348:x1876474438122112:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 525us (768us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1789545723.511252:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11 00010000:00010000:2.0:1789545723.708771:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789545723.808456:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545723.808620:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438122368 00000100:00100000:2.0:1789545723.808642:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438122368 00000100:00100000:2.0:1789545723.808705:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 50 00000100:00100000:2.0:1789545723.808717:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+34:10379:x1876474438122368:12345-192.168.201.16@tcp:101:cat.0 00010000:00010000:2.0:1789545723.808742:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545723.808762:0:10125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c09e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de548f expref: -99 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.808856:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c09f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.808870:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c09f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.808882:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c09f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545723.808893:0:10125:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789545723.809041:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c09e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de548f expref: 37 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.809071:0:10125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c09f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de548f expref: 36 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545723.809080:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe600) 00010000:00010000:2.0:1789545723.809083:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789545723.809087:0:10125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1200, rc 0) 00000100:00100000:2.0:1789545723.809138:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+36:10379:x1876474438122368:12345-192.168.201.16@tcp:101:cat.0 Request processed in 423us (690us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789545723.809155:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 50 00000100:00100000:3.0:1789545723.821122:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545723.821214:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545723.824889:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438122752 00000100:00100000:1.0:1789545723.824904:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438122752 00000100:00100000:1.0:1789545723.824994:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3 00000100:00100000:1.0:1789545723.825005:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd9365850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+36:2359:x1876474438122752:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789545723.825020:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545723.825044:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c09f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de548f expref: 36 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.825075:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe600) 00010000:00010000:1.0:1789545723.825081:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789545723.825154:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd9365850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+35:2359:x1876474438122752:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 150us (3938us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545723.825162:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3 00000100:00100000:2.0:1789545723.825404:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438122624 00000100:00100000:2.0:1789545723.825420:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438122624 00000100:00100000:2.0:1789545723.825454:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12 00000100:00100000:2.0:1789545723.825462:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+35:10379:x1876474438122624:12345-192.168.201.16@tcp:35:cat.0 00000100:00100000:2.0:1789545723.825661:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+36:10379:x1876474438122624:12345-192.168.201.16@tcp:35:cat.0 Request processed in 198us (4547us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1789545723.825668:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12 00000100:00100000:0.0:1789545723.935329:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545723.935601:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438123008 00000100:00100000:1.0:1789545723.935615:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438123008 00000100:00100000:1.0:1789545723.935695:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 51 00000100:00100000:1.0:1789545723.935707:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+36:10386:x1876474438123008:12345-192.168.201.16@tcp:101:dd.0 00010000:00010000:1.0:1789545723.935751:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545723.935755:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789545723.935791:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0956 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5465 expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.935840:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:1.0:1789545723.935846:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789545723.935865:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c09fe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5496 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.935998:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c0a05 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.936015:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c09d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5488 expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.936023:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c0a05 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.936068:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c09d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5488 expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.936084:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c09d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5488 expref: 36 pid: 5846 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545723.936100:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf4ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1876474454932480:192.168.201.16@tcp:104: 00000100:00100000:1.0:1789545723.936228:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfc40b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789545723.939814:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545723.939974:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438123136 00000100:00100000:3.0:1789545723.939987:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438123136 00010000:00010000:3.0:1789545723.940052:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c09d4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5488 expref: 37 pid: 5846 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545723.940125:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 38 00000100:00100000:3.0:1789545723.940138:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a8edb7a-f384-4468-93f4-9d664f284862+37:2361:x1876474438123136:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789545723.940170:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545723.940179:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c09d4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5488 expref: 37 pid: 5846 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545723.940194:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c09d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5488 expref: 37 pid: 5846 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545723.940233:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe600) 00010000:00010000:3.0:1789545723.940238:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c0a05 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545723.940250:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c0a05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545723.940259:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c0a05 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545723.940284:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545723.940355:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a8edb7a-f384-4468-93f4-9d664f284862+37:2361:x1876474438123136:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 219us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545723.940400:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 38 00010000:00010000:1.0:1789545723.940816:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c09d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5488 expref: 36 pid: 5846 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545723.940837:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf4ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1876474454932480:192.168.201.16@tcp:104: 00010000:00010000:1.0:1789545723.940873:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c0a05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.940883:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c0a05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.940890:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c0a05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789545723.940914:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789545723.941148:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c09fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5496 expref: 37 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.941672:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c0a05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5496 expref: 36 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.941682:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe600) 00010000:00010000:1.0:1789545723.941686:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789545723.941689:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba9800, rc 0) 00000100:00100000:1.0:1789545723.941770:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+36:10386:x1876474438123008:12345-192.168.201.16@tcp:101:dd.0 Request processed in 6064us (6455us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1789545723.941779:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 51 00000100:00100000:2.0:1789545723.945947:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545723.946107:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438123392 00000100:00100000:3.0:1789545723.946121:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438123392 00000100:00100000:3.0:1789545723.946209:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 52 00000100:00100000:3.0:1789545723.946222:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+36:10386:x1876474438123392:12345-192.168.201.16@tcp:36:dd.0 00010000:00010000:3.0:1789545723.946899:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0a13 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545723.946923:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0a13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545723.946936:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0a13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789545723.946997:0:10125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1789545723.947026:0:10125:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e766373 reply state 00000000fb3b1c8d transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0a13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545723.947037:0:10125:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789545723.947580:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+39:10386:x1876474438123392:12345-192.168.201.16@tcp:36:dd.0 Request processed in 1357us (1646us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1789545723.947589:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 52 00000020:00080000:3.0:1789545723.947596:0:10125:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789545723.956635:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0a13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.956659:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0a13 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.956669:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0a13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.956703:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217f600 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545723.956710:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0a13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.956718:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0a13 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.956753:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe600) 00010000:00010000:1.0:1789545723.956757:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545723.956763:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0a13 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545723.956770:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0a13 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545723.965012:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4942a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454932608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789545723.965112:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545723.965542:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454932608 00000100:00100000:1.0:1789545723.965553:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454932608 00000100:00100000:1.0:1789545723.965625:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789545723.965636:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876474454932608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789545723.965666:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789545723.965754:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876474454932608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545723.965762:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789545723.965830:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4942a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454932608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789545723.966458:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454932736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789545723.966514:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545723.967027:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454932736 00000100:00100000:1.0:1789545723.967036:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454932736 00000100:00100000:1.0:1789545723.967090:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789545723.967099:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454932736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789545723.967175:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789545723.967237:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454932736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545723.967245:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789545723.967466:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454932736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789545724.337317:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545724.337582:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438123520 00000100:00100000:0.0:1789545724.337600:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438123520 00000100:00100000:0.0:1789545724.337730:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 53 00000100:00100000:0.0:1789545724.337745:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+38:10400:x1876474438123520:12345-192.168.201.16@tcp:101:stat.0 00010000:00010000:0.0:1789545724.337779:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545724.337805:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0a1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de549d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.337895:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0a21 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.337915:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0a21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.337934:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0a21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.337972:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c0a28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.337981:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c0a28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.337990:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c0a28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.338102:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0a2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.338116:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c0a05 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5496 expref: 39 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.338125:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0a2f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.338186:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c0a05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5496 expref: 39 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.338205:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c0a05 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5496 expref: 39 pid: 5848 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545724.338230:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be76d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876474454932864:192.168.201.16@tcp:104: 00000100:00100000:0.0:1789545724.338423:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdf604f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789545724.338485:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545724.338562:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438123648 00000100:00100000:0.0:1789545724.338570:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438123648 00000100:00100000:0.0:1789545724.338638:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 286 00000100:00100000:3.0:1789545724.338642:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545724.338662:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2358:x1876474438123648:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:3.0:1789545724.338684:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:2.0:1789545724.338887:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789545724.338905:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438123904 00000100:00100000:2.0:1789545724.338910:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438123904 00000100:00100000:2.0:1789545724.338953:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 131 00000100:00100000:2.0:1789545724.338962:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2358:x1876474438123904:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:0.0:1789545724.339007:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2358:x1876474438123648:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 350us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545724.339016:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 286 00000100:00080000:1.0:1789545724.343049:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789545724.343101:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438123776 00000100:00100000:1.0:1789545724.343117:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438123776 00000100:00100000:1.0:1789545724.345495:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 72 00000100:00100000:1.0:1789545724.345520:0:8211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4940e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a8edb7a-f384-4468-93f4-9d664f284862+7:2358:x1876474438123776:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545724.345711:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2358:x1876474438123904:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 6744us (7077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545724.345725:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 131 00000100:00100000:1.0:1789545724.346036:0:8211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4940e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a8edb7a-f384-4468-93f4-9d664f284862+7:2358:x1876474438123776:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 528us (7353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545724.346044:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 72 00000100:00100000:3.0:1789545724.351563:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545724.351714:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438124160 00000100:00100000:2.0:1789545724.351742:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438124160 00000100:00100000:2.0:1789545724.351831:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 13 00000100:00100000:2.0:1789545724.351842:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+40:5593:x1876474438124160:12345-192.168.201.16@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789545724.352804:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+41:5593:x1876474438124160:12345-192.168.201.16@tcp:35:ldlm_bl.0 Request processed in 958us (1245us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1789545724.352833:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 13 00000100:00100000:2.0:1789545724.357905:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545724.358055:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438124288 00000100:00100000:3.0:1789545724.358079:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438124288 00010000:00010000:3.0:1789545724.358134:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c0a05 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5496 expref: 41 pid: 5848 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545724.358350:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 39 00000100:00100000:3.0:1789545724.358426:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+41:2358:x1876474438124288:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789545724.358472:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545724.358487:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c0a05 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5496 expref: 41 pid: 5848 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545724.358506:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c0a05 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5496 expref: 41 pid: 5848 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545724.358527:0:7637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe600) 00010000:00010000:3.0:1789545724.358537:0:7637:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0a2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545724.358546:0:7637:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0a2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545724.358555:0:7637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0a2f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545724.358580:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545724.358648:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+41:2358:x1876474438124288:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 289us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545724.358655:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 39 00010000:00010000:0.0:1789545724.360439:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c0a05 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5496 expref: 40 pid: 5848 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545724.360466:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be76d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876474454932864:192.168.201.16@tcp:104: 00010000:00010000:0.0:1789545724.360504:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0a2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.360514:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0a2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.360519:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0a2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789545724.360576:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789545724.360580:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789545724.360632:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0a2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.360647:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0a2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.360661:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0a21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.360667:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0a21 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.360690:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0a21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.360703:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb7400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545724.360707:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0a21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.360715:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0a21 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.360734:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:0.0:1789545724.360737:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545724.360742:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0a21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.360748:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0a21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.360766:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c0a28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.360772:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c0a28 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.360778:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c0a28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.360789:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb7c00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545724.360792:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c0a28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.360808:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c0a28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.360816:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff994bc4f11900) 00010000:00010000:0.0:1789545724.360818:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545724.360821:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c0a28 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.360834:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c0a28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.360883:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0a1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de549d expref: 40 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.360898:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0a2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de549d expref: 39 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.360905:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe600) 00010000:00010000:0.0:1789545724.360907:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789545724.360909:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb7200, rc 0) 00000100:00100000:0.0:1789545724.362922:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+39:10400:x1876474438123520:12345-192.168.201.16@tcp:101:stat.0 Request processed in 25170us (25611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545724.362935:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 53 00000100:00100000:2.0:1789545724.434600:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545724.436973:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438124544 00000100:00100000:3.0:1789545724.436994:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438124544 00000100:00100000:3.0:1789545724.437102:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 54 00000100:00100000:3.0:1789545724.437115:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+39:10406:x1876474438124544:12345-192.168.201.16@tcp:36:truncate.0 00010000:00010000:3.0:1789545724.437213:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545724.437259:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0a2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de549d expref: 39 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545724.437309:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe600) 00010000:00010000:3.0:1789545724.437316:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789545724.437680:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0a36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545724.437698:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0a36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545724.437711:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0a36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789545724.438323:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1789545724.438356:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001fa607d5 reply state 000000008ee55200 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0a36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545724.438398:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789545724.438581:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+41:10406:x1876474438124544:12345-192.168.201.16@tcp:36:truncate.0 Request processed in 1466us (3993us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1789545724.438592:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 54 00000020:00080000:3.0:1789545724.438602:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789545724.458820:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0a36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.458844:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0a36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.459310:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0a36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.459316:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217fa00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545724.459320:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0a36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.459328:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0a36 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.459346:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe600) 00010000:00010000:0.0:1789545724.459348:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545724.459353:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0a36 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.459389:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0a36 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789545724.539027:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967315 is committed 00000001:00080000:0.0:1789545724.539056:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967333 is committed 00000004:00080000:0.0:1789545724.539068:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1789545724.545432:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff994bdfc40840 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1789545724.545460:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994bdf68bb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff994bdfc40240 00000020:00080000:0.0:1789545724.545464:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994bdf68b300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff994be4c3ac00 00000001:00080000:0.0:1789545724.545513:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967336 is committed 00000001:00080000:0.0:1789545724.545546:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967338 is committed 00000020:00080000:1.0:1789545724.545739:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1789545724.545947:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1789545724.546745:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789545724.546892:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454932992:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789545724.547064:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545724.547288:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454932992 00000100:00100000:0.0:1789545724.547299:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454932992 00000100:00100000:0.0:1789545724.547658:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789545724.547692:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf4ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1876474454932992:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789545724.547736:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1789545724.547804:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aaa4cfb, atime: 0x6aaa4cfb, ctime: 0x6aaa4cfb, blocks: 0x1 00010000:00010000:0.0:1789545724.547816:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000712e86a3/0x64919c0f856c0a3d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.547838:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=338s v=(0 0) 00010000:00010000:0.0:1789545724.547843:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789545724.547851:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000712e86a3/0x64919c0f856c0a3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.547870:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000712e86a3/0x64919c0f856c0a3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.547881:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000712e86a3/0x64919c0f856c0a3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.547889:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000712e86a3/0x64919c0f856c0a3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.547920:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789545724.548871:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789545724.548883:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000712e86a3/0x64919c0f856c0a3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.548897:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6800 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:1.0:1789545724.548903:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000712e86a3/0x64919c0f856c0a3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.548915:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000712e86a3/0x64919c0f856c0a3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.548948:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000712e86a3/0x64919c0f856c0a3d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.548957:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000712e86a3/0x64919c0f856c0a3d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.548990:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545724.548992:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545724.548994:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545724.549839:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf4ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1876474454932992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2145us (2769us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789545724.549853:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:1.0:1789545724.550029:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff994be4ed6d80/2, rc 0, transno 4294967301 00000100:00100000:1.0:1789545724.550038:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454932992:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789545724.599819:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545724.599943:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438124672 00000100:00100000:0.0:1789545724.599955:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438124672 00000100:00100000:0.0:1789545724.600048:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 55 00000100:00100000:0.0:1789545724.600075:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+10:10420:x1876474438124672:12345-192.168.201.16@tcp:101:stat.0 00010000:00010000:0.0:1789545724.600106:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545724.600130:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c0a44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de54a4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.600219:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0a4b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.600238:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0a4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.600252:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0a4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.600269:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0a52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.600277:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0a52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.600285:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0a52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.601545:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0a59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.601562:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.601636:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789545724.601694:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1789545724.601700:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789545724.601728:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.601743:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.601752:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0a4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.601777:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0a4b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.601784:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0a4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.601791:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb7400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545724.601798:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0a4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.601807:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0a4b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.601821:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:1.0:1789545724.601824:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545724.601829:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0a4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.601835:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0a4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.601850:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0a52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.601856:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0a52 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.601862:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0a52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.601867:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545724.601876:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0a52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.601883:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0a52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.601890:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff994bc4f11e00) 00010000:00010000:1.0:1789545724.601893:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545724.601896:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0a52 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.601902:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0a52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.601947:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c0a44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54a4 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.601974:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0a59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54a4 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.602206:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe600) 00010000:00010000:1.0:1789545724.602209:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789545724.602211:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba9600, rc 0) 00000100:00100000:1.0:1789545724.602316:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+11:10420:x1876474438124672:12345-192.168.201.16@tcp:101:stat.0 Request processed in 2239us (2509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545724.602325:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 55 00000100:00100000:1.0:1789545724.692624:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545724.692829:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438124928 00000100:00100000:0.0:1789545724.692844:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438124928 00000100:00100000:0.0:1789545724.692930:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 56 00000100:00100000:0.0:1789545724.692943:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf4ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+11:10430:x1876474438124928:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:0.0:1789545724.692974:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545724.693001:0:10125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0a60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de54ab expref: -99 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789545724.693172:0:10125:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789545724.693601:0:10125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0a60 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54ab expref: 13 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.693619:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bcd248b00) 00010000:00010000:0.0:1789545724.693622:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789545724.693628:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0a60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54ab expref: 13 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.693644:0:10125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb6600, rc 0) 00000100:00100000:0.0:1789545724.693848:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf4ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+12:10430:x1876474438124928:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 906us (1239us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1789545724.693856:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 56 00000100:00100000:2.0:1789545724.704224:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545724.704408:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438125184 00000100:00100000:1.0:1789545724.704423:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438125184 00000100:00100000:1.0:1789545724.704503:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 14 00000100:00100000:1.0:1789545724.704523:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+12:10430:x1876474438125184:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:1.0:1789545724.704844:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+13:10430:x1876474438125184:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 322us (635us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1789545724.704853:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 14 00010000:00010000:0.0:1789545724.734554:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545724.774872:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545724.775151:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438125440 00000100:00100000:1.0:1789545724.775165:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438125440 00000100:00100000:1.0:1789545724.775435:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 57 00000100:00100000:1.0:1789545724.775450:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+13:10436:x1876474438125440:12345-192.168.201.16@tcp:101:bash.0 00010000:00010000:0.0:1789545724.775580:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545724.775610:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0a6e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de54b2 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.775737:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0a75 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.775752:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0a59 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54a4 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.775759:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0a75 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.775812:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0a59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54a4 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.775823:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0a59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54a4 expref: 14 pid: 5846 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545724.775836:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be76d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876474454933120:192.168.201.16@tcp:104: 00000100:00100000:0.0:1789545724.775946:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdf604c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789545724.779671:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be76d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876474454933120:192.168.201.16@tcp:104: 00010000:00010000:0.0:1789545724.779718:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0a75 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545724.780304:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545724.780755:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438125568 00000100:00100000:3.0:1789545724.780768:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438125568 00010000:00010000:3.0:1789545724.780822:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0a59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54a4 expref: 15 pid: 5846 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545724.780870:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 40 00000100:00100000:3.0:1789545724.780881:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a8edb7a-f384-4468-93f4-9d664f284862+15:2358:x1876474438125568:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789545724.780901:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545724.781174:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0a59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54a4 expref: 15 pid: 5846 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545724.781346:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0a59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54a4 expref: 15 pid: 5846 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545724.781425:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0a59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54a4 expref: 15 pid: 5846 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545724.781447:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe600) 00010000:00010000:3.0:1789545724.781453:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0a75 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545724.781464:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0a75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545724.781473:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0a75 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545724.781511:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545724.781644:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a8edb7a-f384-4468-93f4-9d664f284862+14:2358:x1876474438125568:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 763us (1342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545724.781655:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 40 00010000:00010000:0.0:1789545724.781736:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0a75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.781745:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0a75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789545724.781770:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1789545724.782001:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0a6e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54b2 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.782019:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0a75 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54b2 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.782026:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe600) 00010000:00010000:0.0:1789545724.782030:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789545724.782042:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb6400, rc 0) 00000100:00100000:0.0:1789545724.782071:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+14:10436:x1876474438125440:12345-192.168.201.16@tcp:101:bash.0 Request processed in 6626us (7214us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1789545724.782078:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 57 00000100:00100000:3.0:1789545724.785146:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545724.785308:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438125824 00000100:00100000:0.0:1789545724.785323:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438125824 00000100:00100000:0.0:1789545724.786203:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 58 00000100:00100000:0.0:1789545724.786224:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+14:10436:x1876474438125824:12345-192.168.201.16@tcp:36:bash.0 00010000:00010000:0.0:1789545724.786630:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0a83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.786652:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0a83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.786665:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0a83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789545724.786722:0:10125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1789545724.786747:0:10125:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ecce7e6a reply state 00000000842c0e5d transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0a83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545724.786757:0:10125:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789545724.786884:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+17:10436:x1876474438125824:12345-192.168.201.16@tcp:36:bash.0 Request processed in 668us (1749us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1789545724.786893:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 58 00000020:00080000:0.0:1789545724.786899:0:10125:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789545724.797905:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545724.798002:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438125952 00000100:00100000:3.0:1789545724.798015:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438125952 00000100:00100000:3.0:1789545724.798094:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 59 00000100:00100000:3.0:1789545724.798107:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+17:10436:x1876474438125952:12345-192.168.201.16@tcp:101:bash.0 00010000:00010000:3.0:1789545724.798140:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545724.798184:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0a8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de54b9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545724.798297:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0a91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545724.798315:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0a75 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54b2 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545724.798324:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0a83 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545724.798332:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0a91 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545724.798355:0:5846:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0a83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545724.798435:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0a75 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54b2 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545724.798450:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0a75 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54b2 expref: 18 pid: 5847 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545724.798465:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4941c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876474454933248:192.168.201.16@tcp:104: 00000100:00100000:3.0:1789545724.798562:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff994be75f03c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789545724.799021:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0a83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.799033:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0a83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.799041:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0a83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.799048:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb7800 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545724.799052:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0a83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.799062:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0a83 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.799081:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe600) 00010000:00010000:1.0:1789545724.799084:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545724.799088:0:3297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0a91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.799097:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0a83 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.799114:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0a83 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545724.800738:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4941c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876474454933248:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545724.800776:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0a91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545724.809852:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545724.809984:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438126080 00000100:00100000:1.0:1789545724.809999:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438126080 00010000:00010000:1.0:1789545724.810065:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0a75 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54b2 expref: 18 pid: 5847 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545724.810118:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 41 00000100:00100000:1.0:1789545724.810131:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a8edb7a-f384-4468-93f4-9d664f284862+18:2359:x1876474438126080:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789545724.810150:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545724.810158:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0a75 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54b2 expref: 18 pid: 5847 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.810175:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0a75 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54b2 expref: 18 pid: 5847 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.810223:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0a75 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54b2 expref: 18 pid: 5847 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.810246:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe600) 00010000:00010000:1.0:1789545724.810251:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0a91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.810262:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0a91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.810272:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0a91 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.810330:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789545724.810354:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0a91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545724.810405:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0a91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545724.810541:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000100:00100000:1.0:1789545724.810542:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a8edb7a-f384-4468-93f4-9d664f284862+17:2359:x1876474438126080:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 412us (705us total) trans 0 rc 0/0 00000004:00200000:2.0:1789545724.810546:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:1.0:1789545724.810550:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 41 00000004:00010000:2.0:1789545724.810575:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0a91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545724.810616:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0a8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54b9 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545724.810635:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0a91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54b9 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545724.810644:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe600) 00010000:00010000:2.0:1789545724.810647:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789545724.810650:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217fe00, rc 0) 00000100:00100000:2.0:1789545724.810684:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+16:10436:x1876474438125952:12345-192.168.201.16@tcp:101:bash.0 Request processed in 12580us (12795us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545724.810693:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 59 00000100:00100000:2.0:1789545724.814517:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545724.814680:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438126336 00000100:00100000:3.0:1789545724.814695:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438126336 00000100:00100000:3.0:1789545724.814767:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 15 00000100:00100000:3.0:1789545724.814779:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8cc5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+16:10436:x1876474438126336:12345-192.168.201.16@tcp:35:bash.0 00000100:00100000:3.0:1789545724.815126:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8cc5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+17:10436:x1876474438126336:12345-192.168.201.16@tcp:35:bash.0 Request processed in 348us (635us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1789545724.815134:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 15 00000100:00100000:1.0:1789545724.907851:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545724.907972:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438126592 00000100:00100000:3.0:1789545724.907995:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438126592 00000100:00100000:3.0:1789545724.908074:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 60 00000100:00100000:3.0:1789545724.908088:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf4efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+17:10446:x1876474438126592:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:3.0:1789545724.908122:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545724.908146:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0a98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de54c0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545724.908511:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789545724.908668:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0a98 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54c0 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545724.908686:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bcd248b00) 00010000:00010000:3.0:1789545724.908708:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789545724.908716:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0a98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54c0 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545724.908736:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217fc00, rc 0) 00000100:00100000:3.0:1789545724.908824:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf4efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+18:10446:x1876474438126592:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 739us (987us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1789545724.908833:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 60 00000100:00100000:0.0:1789545724.916073:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545724.916431:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438126720 00000100:00100000:1.0:1789545724.916449:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438126720 00000100:00100000:1.0:1789545724.916540:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 61 00000100:00100000:1.0:1789545724.916555:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+18:10446:x1876474438126720:12345-192.168.201.16@tcp:34:lfs.0 00010000:00010000:1.0:1789545724.916662:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c0aa6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.916685:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c0aa6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.916699:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c0aa6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.916717:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c0aad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.916724:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c0aad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.916731:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c0aad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.917112:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0ab4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.917134:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.917142:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789545724.917218:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.917233:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c0aa6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.917240:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c0aa6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.917247:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c0aa6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.917255:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba9200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545724.917260:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c0aa6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.917269:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c0aa6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.917283:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:1.0:1789545724.917286:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545724.917292:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c0aa6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.917299:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c0aa6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.917321:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c0aad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.917327:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c0aad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.917333:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c0aad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.917338:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba9c00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545724.917342:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c0aad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.917348:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c0aad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.917356:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff994bc4ffe400) 00010000:00010000:1.0:1789545724.917429:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545724.917434:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c0aad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.917440:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c0aad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.917456:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.917462:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0ab4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.917468:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0ab4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.917479:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba9600 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545724.917482:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0ab4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.917488:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0ab4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.917496:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe600) 00010000:00010000:1.0:1789545724.917498:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545724.917501:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0ab4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.917506:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0ab4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545724.917604:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+18:10446:x1876474438126720:12345-192.168.201.16@tcp:34:lfs.0 Request processed in 1050us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545724.917613:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 61 00000100:00100000:2.0:1789545724.921621:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545724.927823:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438126976 00000100:00100000:3.0:1789545724.927848:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438126976 00000100:00100000:3.0:1789545724.927940:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 16 00000100:00100000:3.0:1789545724.927953:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+18:10446:x1876474438126976:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:3.0:1789545724.928288:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+19:10446:x1876474438126976:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 336us (6681us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1789545724.928296:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 16 00000100:00100000:0.0:1789545724.976112:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545724.977710:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438127232 00000100:00100000:3.0:1789545724.977731:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438127232 00000100:00100000:3.0:1789545724.977829:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 62 00000100:00100000:3.0:1789545724.977853:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+19:10449:x1876474438127232:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:3.0:1789545724.977886:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545724.977912:0:10125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0abb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de54c7 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545724.978016:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0ac2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545724.978034:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0ac2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545724.978067:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0ac2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545724.978086:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0ac9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545724.978094:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545724.978101:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545724.978706:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0ad0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545724.978720:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545724.978729:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545724.978743:0:10125:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789545724.978863:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0ac2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545724.978872:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0ac2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545724.978880:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0ac2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545724.978901:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217e400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545724.978906:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0ac2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545724.978915:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0ac2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545724.978939:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:2.0:1789545724.978943:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545724.978950:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0ac2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545724.978957:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0ac2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545724.978982:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545724.978989:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0ac9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545724.978996:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545724.979002:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217fa00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545724.979005:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545724.979011:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0ac9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545724.979019:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff994bc4f9ed00) 00010000:00010000:2.0:1789545724.979022:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545724.979025:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0ac9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545724.979030:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0ac9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545724.979087:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0abb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54c7 expref: 22 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545724.979102:0:10125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0ad0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54c7 expref: 21 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545724.979122:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe600) 00010000:00010000:2.0:1789545724.979124:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789545724.979127:0:10125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0200, rc 0) 00000100:00100000:2.0:1789545724.979228:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+21:10449:x1876474438127232:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 1388us (3132us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1789545724.979238:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 62 00000100:00100000:1.0:1789545724.985685:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545724.985811:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438127360 00000100:00100000:0.0:1789545724.985825:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438127360 00000100:00100000:0.0:1789545724.985932:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 63 00000100:00100000:0.0:1789545724.985945:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf4ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+21:10449:x1876474438127360:12345-192.168.201.16@tcp:54:lfs.0 00010000:00010000:0.0:1789545724.986038:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0ade lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.986060:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.986074:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.986111:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.986118:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0ade lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.986126:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0ade lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.986133:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb7000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545724.986138:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0ade lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.986147:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0ade lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.986161:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe600) 00010000:00010000:0.0:1789545724.986165:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789545724.986171:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0ade lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545724.986189:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0ade lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545724.986288:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf4ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+21:10449:x1876474438127360:12345-192.168.201.16@tcp:54:lfs.0 Request processed in 345us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545724.986296:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 63 00000100:00100000:3.0:1789545724.991316:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545724.991505:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438127488 00000100:00100000:1.0:1789545724.991520:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438127488 00000100:00100000:1.0:1789545724.991605:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 4 00000100:00100000:1.0:1789545724.991618:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4943480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+21:2359:x1876474438127488:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789545724.991640:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545724.991674:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0ad0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54c7 expref: 21 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545724.991698:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe600) 00010000:00010000:1.0:1789545724.991720:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789545724.991808:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4943480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+20:2359:x1876474438127488:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 191us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545724.991817:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 4 00000100:00100000:1.0:1789545724.993572:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545724.997032:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438127744 00000100:00100000:3.0:1789545724.997057:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438127744 00000100:00100000:3.0:1789545724.997151:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 17 00000100:00100000:3.0:1789545724.997164:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf4ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+20:10449:x1876474438127744:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:2.0:1789545724.997896:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf4ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+21:10449:x1876474438127744:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 723us (4324us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1789545724.997909:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 17 00000100:00100000:2.0:1789545725.177595:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545725.177853:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438128000 00000100:00100000:1.0:1789545725.177868:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438128000 00000100:00100000:1.0:1789545725.177947:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 64 00000100:00100000:1.0:1789545725.177959:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+21:10467:x1876474438128000:12345-192.168.201.16@tcp:101:cat.0 00010000:00010000:1.0:1789545725.178005:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545725.178033:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c0ae5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de54ce expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545725.178170:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c0aec lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545725.178204:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c0aec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545725.178222:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c0aec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789545725.178236:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789545725.178692:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c0ae5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54ce expref: 24 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545725.178732:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c0aec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54ce expref: 23 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545725.178765:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe600) 00010000:00010000:1.0:1789545725.178768:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789545725.178773:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba9200, rc 0) 00000100:00100000:1.0:1789545725.178863:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+23:10467:x1876474438128000:12345-192.168.201.16@tcp:101:cat.0 Request processed in 906us (1282us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1789545725.178871:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 64 00000100:00100000:3.0:1789545725.207232:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545725.207440:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438128128 00000100:00100000:0.0:1789545725.207454:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438128128 00000100:00100000:0.0:1789545725.207672:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 65 00000100:00100000:0.0:1789545725.207686:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+23:10468:x1876474438128128:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:0.0:1789545725.207734:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545725.207765:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0afa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de54d5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545725.207859:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c0b01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545725.207878:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c0b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545725.207891:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c0b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789545725.207938:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789545725.207941:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789545725.207963:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c0b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545725.208005:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0afa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54d5 expref: 25 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545725.208047:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c0b01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54d5 expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545725.208057:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:0.0:1789545725.208061:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789545725.208066:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb6200, rc 0) 00000100:00100000:0.0:1789545725.208152:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+24:10468:x1876474438128128:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 469us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545725.208159:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 65 00000100:00100000:0.0:1789545725.215442:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545725.215852:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438128512 00000100:00100000:2.0:1789545725.215867:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438128512 00000100:00100000:2.0:1789545725.215952:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 18 00000100:00100000:2.0:1789545725.215965:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+24:10468:x1876474438128512:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:2.0:1789545725.216882:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+25:10468:x1876474438128512:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 914us (1450us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1789545725.216891:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 18 00000100:00100000:1.0:1789545725.220786:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545725.220902:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438128640 00000100:00100000:3.0:1789545725.220917:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438128640 00000100:00100000:3.0:1789545725.221139:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 5 00000100:00100000:3.0:1789545725.221153:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf4edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a8edb7a-f384-4468-93f4-9d664f284862+25:10468:x1876474438128640:12345-192.168.201.16@tcp:103:lfs.0 00010000:00010000:3.0:1789545725.221172:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789545725.221218:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0a91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54b9 expref: 25 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.221249:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c0aec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54ce expref: 24 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.221294:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c0995 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de547a expref: 23 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.221307:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe600) 00010000:00010000:3.0:1789545725.221322:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545725.221453:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf4edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a8edb7a-f384-4468-93f4-9d664f284862+22:10468:x1876474438128640:12345-192.168.201.16@tcp:103:lfs.0 Request processed in 302us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545725.222432:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 5 00000100:00100000:3.0:1789545725.226429:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545725.226709:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438128768 00000100:00100000:1.0:1789545725.226733:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438128768 00000100:00100000:1.0:1789545725.226810:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 66 00000100:00100000:1.0:1789545725.226822:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+22:10468:x1876474438128768:12345-192.168.201.16@tcp:58:lfs.0 00010000:00010000:1.0:1789545725.226994:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0b08 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545725.227015:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0b08 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545725.227030:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0b08 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789545725.227806:0:5848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789545725.228021:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1789545725.228076:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1789545725.228217:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+22:10468:x1876474438128768:12345-192.168.201.16@tcp:58:lfs.0 Request processed in 1392us (1801us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545725.228228:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 66 00000100:00100000:1.0:1789545725.258131:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545725.259677:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438128896 00000100:00100000:2.0:1789545725.259697:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438128896 00000100:00100000:2.0:1789545725.259941:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 67 00000100:00100000:2.0:1789545725.259955:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf4eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+22:10470:x1876474438128896:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:2.0:1789545725.259983:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545725.260011:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0b0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de54dc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.260125:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0b16 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.260143:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0b16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.260157:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0b16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.260176:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0b1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.260184:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.260192:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.260540:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0b24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.260551:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0b24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.260559:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0b24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545725.260602:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789545725.260607:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789545725.260630:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0b24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.260655:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0b24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.260664:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0b16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.260671:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0b16 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.260679:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0b16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.260686:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545725.260691:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0b16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.260700:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0b16 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.260713:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:2.0:1789545725.260727:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545725.260734:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0b16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.260741:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0b16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.260755:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.260761:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0b1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.260774:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0b1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.260779:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545725.260782:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0b1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.260789:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0b1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.260797:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff994bcd248800) 00010000:00010000:2.0:1789545725.260799:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545725.260802:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0b1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.260808:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0b1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.260844:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0b0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54dc expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.260859:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0b24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54dc expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.260866:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe400) 00010000:00010000:2.0:1789545725.260868:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789545725.260871:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0a00, rc 0) 00000100:00100000:2.0:1789545725.260972:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf4eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+23:10470:x1876474438128896:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 1018us (2855us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545725.260989:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 67 00010000:00010000:0.0:1789545725.760621:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789545725.884704:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789545725.884718:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789545725.884791:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789545725.884800:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789545725.884980:0:11700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf4ee680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1876474454933376:192.168.201.16@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789545725.885115:0:11700:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc644b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789545725.902589:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545725.902648:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438129024 00000100:00100000:0.0:1789545725.902662:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438129024 00000100:00100000:0.0:1789545725.902726:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1 00000100:00100000:0.0:1789545725.902738:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8a8edb7a-f384-4468-93f4-9d664f284862+24:10481:x1876474438129024:12345-192.168.201.16@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789545725.902849:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8a8edb7a-f384-4468-93f4-9d664f284862+24:10481:x1876474438129024:12345-192.168.201.16@tcp:900:lhsmtool_posix.0 Request processed in 113us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545725.902858:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1 00000100:00100000:1.0:1789545725.903414:0:11700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf4ee680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1876474454933376:192.168.201.16@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789545725.909769:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545725.912929:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438129152 00000100:00100000:1.0:1789545725.912953:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438129152 00000100:00100000:1.0:1789545725.913067:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 68 00000100:00100000:1.0:1789545725.913082:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+23:10481:x1876474438129152:12345-192.168.201.16@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789545725.913127:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789545725.913296:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+23:10481:x1876474438129152:12345-192.168.201.16@tcp:53:lhsmtool_posix.0 Request processed in 217us (3535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545725.913305:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 68 00000100:00100000:0.0:1789545725.925338:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545725.925559:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438129280 00000100:00100000:3.0:1789545725.925575:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438129280 00000100:00100000:3.0:1789545725.925667:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 69 00000100:00100000:3.0:1789545725.925680:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+23:10481:x1876474438129280:12345-192.168.201.16@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789545725.925785:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0b2b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.925808:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0b2b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.925822:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0b2b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.925841:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0b32 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.925848:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0b32 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.925877:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0b32 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.925913:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0b39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.925924:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0b39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.925931:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0b39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545725.925995:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789545725.926000:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789545725.926021:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0b39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.926035:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0b2b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.926042:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0b2b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.926049:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0b2b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.926055:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217f600 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545725.926060:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0b2b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.926067:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0b2b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.926090:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff994bc4f11700) 00010000:00010000:3.0:1789545725.926093:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545725.926100:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0b2b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.926106:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0b2b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.926126:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0b32 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.926133:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0b32 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.926140:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0b32 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.926146:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217fe00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545725.926149:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0b32 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.926155:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0b32 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.926162:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff994bc4f9e300) 00010000:00010000:3.0:1789545725.926164:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545725.926167:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0b32 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.926173:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0b32 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.926321:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0b39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.926327:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0b39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.926332:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0b39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.926337:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217f400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545725.926340:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0b39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.926346:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0b39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.926353:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe400) 00010000:00010000:3.0:1789545725.926356:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545725.926415:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0b39 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.926422:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0b39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545725.926533:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+23:10481:x1876474438129280:12345-192.168.201.16@tcp:34:lhsmtool_posix.0 Request processed in 853us (1200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545725.926545:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 69 00000100:00100000:1.0:1789545725.944125:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545725.945026:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438129536 00000100:00100000:3.0:1789545725.945044:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438129536 00000100:00100000:3.0:1789545725.945127:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 70 00000100:00100000:3.0:1789545725.945148:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf4ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+23:10481:x1876474438129536:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789545725.945726:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545725.953385:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0b40 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de54e3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.953521:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0b47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.953539:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.953553:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545725.953567:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789545725.953674:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.953682:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0b47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.953690:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0b47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.953697:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545725.953701:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0b47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.953708:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0b47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.953721:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe400) 00010000:00010000:2.0:1789545725.953733:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789545725.953739:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0b47 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.953744:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0b47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.953791:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0b40 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54e3 expref: 25 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.953801:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff994bc4f11700) 00010000:00010000:2.0:1789545725.953803:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789545725.953807:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0b40 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54e3 expref: 25 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.953818:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0000, rc 0) 00000100:00100000:2.0:1789545725.953898:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf4ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+24:10481:x1876474438129536:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 8753us (9788us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1789545725.957266:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 70 00000100:00100000:3.0:1789545725.966134:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545725.966266:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438129664 00000100:00100000:1.0:1789545725.966283:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438129664 00000100:00100000:1.0:1789545725.966407:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 71 00000100:00100000:1.0:1789545725.966423:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+24:10481:x1876474438129664:12345-192.168.201.16@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789545725.966475:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789545725.966621:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+24:10481:x1876474438129664:12345-192.168.201.16@tcp:53:lhsmtool_posix.0 Request processed in 202us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545725.966630:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 71 00000100:00100000:1.0:1789545725.970490:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545725.972772:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438129920 00000100:00100000:3.0:1789545725.972796:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438129920 00000100:00100000:3.0:1789545725.972893:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 72 00000100:00100000:3.0:1789545725.972912:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf4ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+24:10481:x1876474438129920:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789545725.972943:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545725.972947:0:10125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789545725.972984:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c0b01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54d5 expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545725.973008:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:3.0:1789545725.973015:0:10125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789545725.973033:0:10125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0b55 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de54ea expref: -99 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789545725.974345:0:10125:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1789545725.974674:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0b5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.974692:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.974704:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.974776:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0b55 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54ea expref: 26 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.974806:0:10125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0b5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54ea expref: 25 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545725.974815:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff994bcd248800) 00010000:00010000:2.0:1789545725.974818:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789545725.974822:0:10125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0000, rc 0) 00000100:00100000:2.0:1789545725.974896:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf4ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+25:10481:x1876474438129920:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 1989us (4421us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1789545725.974905:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 72 00000100:00100000:1.0:1789545725.979356:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545725.979830:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438130176 00000100:00100000:0.0:1789545725.979847:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438130176 00000100:00100000:0.0:1789545725.979913:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 73 00000100:00100000:0.0:1789545725.979925:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf4ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+25:10481:x1876474438130176:12345-192.168.201.16@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789545725.979993:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789545725.980039:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0b5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54ea expref: 25 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545725.980073:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff994bcd248800) 00010000:00010000:0.0:1789545725.980084:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789545725.980113:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0b6a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545725.980132:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0b6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545725.980226:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0b6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545725.980243:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0b71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xc687f52a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545725.980250:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0b71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc687f52a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545725.980257:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0b71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc687f52a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545725.980501:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0b6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545725.980509:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0b6a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545725.980515:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0b6a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545725.980526:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6800 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545725.980530:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0b6a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545725.980538:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0b6a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545725.980550:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:0.0:1789545725.980553:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545725.980558:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0b6a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545725.980565:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0b6a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545725.980576:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0b71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc687f52a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545725.980582:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0b71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc687f52a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545725.980588:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0b71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc687f52a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545725.980593:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb7400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545725.980596:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0b71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc687f52a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545725.980601:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0b71 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc687f52a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545725.980619:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xc687f52a (ffff994bc4f11a00) 00010000:00010000:0.0:1789545725.980622:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545725.980624:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0b71 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc687f52a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545725.980747:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0b71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc687f52a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545725.980885:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf4ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+24:10481:x1876474438130176:12345-192.168.201.16@tcp:36:lhsmtool_posix.0 Request processed in 961us (1545us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789545725.980894:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 73 00000100:00100000:0.0:1789545725.986407:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545725.986994:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438130304 00000100:00100000:1.0:1789545725.987013:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438130304 00000100:00100000:1.0:1789545725.987106:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 74 00000100:00100000:1.0:1789545725.987119:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+24:10481:x1876474438130304:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789545725.987147:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545725.987390:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c0b78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de54f1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545725.987442:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c0b7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545725.987459:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c0b7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545725.987474:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c0b7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545725.987612:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c0b78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54f1 expref: 26 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545725.987636:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c0b7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54f1 expref: 25 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545725.987648:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff994bc4ffec00) 00010000:00010000:1.0:1789545725.987652:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789545725.987657:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba8200, rc 0) 00000100:00100000:1.0:1789545725.987748:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+25:10481:x1876474438130304:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 631us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545725.987758:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 74 00000100:00100000:1.0:1789545725.999969:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545726.000171:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438130560 00000100:00100000:3.0:1789545726.000187:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438130560 00000100:00100000:3.0:1789545726.000289:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 75 00000100:00100000:3.0:1789545726.000303:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+25:10481:x1876474438130560:12345-192.168.201.16@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789545726.000474:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0b86 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.000508:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0b86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.000524:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0b86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789545726.000600:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1789545726.000924:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1789545726.000939:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 339923579065ns, next at 340923575320ns, rc = 0 00000004:00010000:3.0:1789545726.001081:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c8fb48c reply state 0000000049457c77 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0b86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545726.001093:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789545726.001248:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+27:10481:x1876474438130560:12345-192.168.201.16@tcp:36:lhsmtool_posix.0 Request processed in 946us (1301us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1789545726.001257:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 75 00010000:00010000:3.0:1789545726.003287:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0b86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.003311:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0b86 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.003320:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0b86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.003328:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217fe00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545726.003334:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0b86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.003343:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0b86 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.003412:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff994bc4ffec00) 00010000:00010000:3.0:1789545726.003416:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789545726.003425:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0b86 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.003451:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0b86 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545726.005241:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545726.005567:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438130688 00000100:00100000:0.0:1789545726.005583:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438130688 00000100:00100000:0.0:1789545726.005670:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 76 00000100:00100000:0.0:1789545726.005684:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+26:10481:x1876474438130688:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789545726.005719:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545726.005748:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0b8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de54f8 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.005830:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0b8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54f8 expref: 27 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.005858:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0b8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54f8 expref: 27 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.005882:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff994bc4ffec00) 00010000:00010000:0.0:1789545726.005904:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789545726.005910:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb7400, rc 0) 00000100:00100000:0.0:1789545726.005995:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+27:10481:x1876474438130688:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 315us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545726.006003:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 76 00000100:00100000:1.0:1789545726.012249:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545726.012393:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438130816 00000100:00100000:3.0:1789545726.012410:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438130816 00000100:00100000:3.0:1789545726.012468:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 25 00000100:00100000:3.0:1789545726.012479:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1876474438130816:12345-192.168.201.16@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1789545726.012524:0:6693:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 8a8edb7a-f384-4468-93f4-9d664f284862@192.168.201.16@tcp t0 exp 0000000000000000 cur 339 last 0 00000020:00000080:3.0:1789545726.012567:0:6693:0:(genops.c:1384:class_connect()) connect: client 8a8edb7a-f384-4468-93f4-9d664f284862, cookie 0x64919c0f856c0b94 00002000:00100000:3.0:1789545726.012584:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8a8edb7a-f384-4468-93f4-9d664f284862/ffff994bc2bc7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789545726.012615:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789545726.012930:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789545726.012972:0:6693:0:(import.c:65:import_set_state_nolock()) ffff994bc2bc1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789545726.013068:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+6:2357:x1876474438130816:12345-192.168.201.16@tcp:8:lhsmtool_posix.0 Request processed in 589us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545726.013078:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 25 00000100:00100000:1.0:1789545726.017751:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545726.017866:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438130944 00000100:00100000:3.0:1789545726.017881:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438130944 00000100:00100000:3.0:1789545726.017999:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 26 00000100:00100000:3.0:1789545726.018015:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a8edb7a-f384-4468-93f4-9d664f284862+6:0:x1876474438130944:12345-192.168.201.16@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1789545726.018561:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789545726.098622:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:2.0:1789545726.098640:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8a8edb7a-f384-4468-93f4-9d664f284862 00000100:00100000:3.0:1789545726.098813:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a8edb7a-f384-4468-93f4-9d664f284862+5:0:x1876474438130944:12345-192.168.201.16@tcp:2:lhsmtool_posix.0 Request processed in 80796us (81070us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789545726.098825:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 26 00000100:00100000:3.0:1789545726.104825:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545726.108198:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438131200 00000100:00100000:2.0:1789545726.108215:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438131200 00000100:00100000:0.0:1789545726.108539:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 19 00000100:00100000:0.0:1789545726.108550:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+27:10481:x1876474438131200:12345-192.168.201.16@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789545726.108831:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+28:10481:x1876474438131200:12345-192.168.201.16@tcp:35:lhsmtool_posix.0 Request processed in 282us (4016us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1789545726.108839:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 19 00000100:00100000:1.0:1789545726.115688:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545726.115855:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438131456 00000100:00100000:3.0:1789545726.115872:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438131456 00000100:00100000:3.0:1789545726.115973:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 77 00000100:00100000:3.0:1789545726.115985:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+28:10481:x1876474438131456:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789545726.116118:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+28:10481:x1876474438131456:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 Request processed in 134us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545726.116126:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 77 00000100:00100000:1.0:1789545726.128218:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545726.128452:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438131584 00000100:00100000:3.0:1789545726.128462:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438131584 00000100:00100000:3.0:1789545726.128525:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 78 00000100:00100000:3.0:1789545726.128536:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+28:10481:x1876474438131584:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789545726.128557:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545726.128578:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0b9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de54ff expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.128647:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ba2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.128662:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.128675:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545726.128713:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789545726.128730:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.128755:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0b9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54ff expref: 30 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.128789:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54ff expref: 29 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.128798:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff994bc4ffec00) 00010000:00010000:3.0:1789545726.128800:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789545726.128804:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217f600, rc 0) 00000100:00100000:3.0:1789545726.128858:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+29:10481:x1876474438131584:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 324us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545726.128866:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 78 00000100:00100000:1.0:1789545726.133342:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545726.133632:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438131712 00000100:00100000:3.0:1789545726.133643:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438131712 00000100:00100000:3.0:1789545726.133700:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 27 00000100:00100000:3.0:1789545726.133710:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+5:2358:x1876474438131712:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789545726.133727:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545726.133750:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000406e342/0x64919c0f856c0ba9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5506 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789545726.133777:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aaa4cfe, blocks: 0x1 00010000:00010000:3.0:1789545726.133797:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=340s v=(0 0) 00010000:00010000:3.0:1789545726.133803:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789545726.133812:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000406e342/0x64919c0f856c0ba9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5506 expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.133832:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000406e342/0x64919c0f856c0ba9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5506 expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.133863:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217f000, rc 0) 00000100:00100000:3.0:1789545726.133929:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+6:2358:x1876474438131712:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 207us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545726.133936:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 27 00000100:00100000:1.0:1789545726.138292:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545726.138436:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438131968 00000100:00100000:0.0:1789545726.138446:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438131968 00000100:00100000:0.0:1789545726.138498:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 79 00000100:00100000:0.0:1789545726.138508:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+29:10481:x1876474438131968:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789545726.138617:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+29:10481:x1876474438131968:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 Request processed in 110us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545726.138625:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 79 00000100:00100000:1.0:1789545726.141799:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545726.150208:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438132096 00000100:00100000:3.0:1789545726.150224:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438132096 00000100:00100000:3.0:1789545726.150462:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 28 00000100:00100000:3.0:1789545726.150474:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a8edb7a-f384-4468-93f4-9d664f284862+6:10481:x1876474438132096:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789545726.150491:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545726.150510:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5ccc237/0x64919c0f856c0bb0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de550d expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.150540:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000406e342/0x64919c0f856c0ba9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5506 expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.150549:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789545726.150554:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789545726.150559:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5ccc237/0x64919c0f856c0bb0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de550d expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.150594:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000406e342/0x64919c0f856c0ba9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5506 expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.150608:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000406e342/0x64919c0f856c0ba9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5506 expref: 7 pid: 6693 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545726.150632:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4941880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1876474454933504:192.168.201.16@tcp:104: 00000100:00100000:3.0:1789545726.150723:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfae0600 going to sleep for 11 seconds 00000100:00100000:0.0:1789545726.168898:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545726.168966:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438132224 00000100:00100000:1.0:1789545726.168977:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438132224 00010000:00010000:1.0:1789545726.169017:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000406e342/0x64919c0f856c0ba9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5506 expref: 8 pid: 6693 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545726.169062:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 42 00000100:00100000:1.0:1789545726.169072:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd9366850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a8edb7a-f384-4468-93f4-9d664f284862+8:2358:x1876474438132224:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789545726.169087:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545726.169109:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000406e342/0x64919c0f856c0ba9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5506 expref: 8 pid: 6693 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545726.169123:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000406e342/0x64919c0f856c0ba9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5506 expref: 8 pid: 6693 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545726.169149:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789545726.169154:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789545726.169171:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c5ccc237/0x64919c0f856c0bb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de550d expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545726.169182:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5ccc237/0x64919c0f856c0bb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de550d expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545726.169221:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c5ccc237/0x64919c0f856c0bb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de550d expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545726.169234:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994beddf0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5831:1876474454933632:192.168.201.16@tcp:105: 00000100:00100000:1.0:1789545726.169303:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8c2ed80 going to sleep for 11 seconds 00010000:00010000:3.0:1789545726.170068:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000406e342/0x64919c0f856c0ba9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5506 expref: 8 pid: 6693 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545726.170084:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4941880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1876474454933504:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545726.170110:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c5ccc237/0x64919c0f856c0bb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de550d expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.170123:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217fe00, rc 0) 00000100:00100000:3.0:1789545726.170183:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a8edb7a-f384-4468-93f4-9d664f284862+7:10481:x1876474438132096:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 19710us (28394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545726.170192:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 28 00000100:00100000:0.0:1789545726.184763:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545726.184856:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994beddf0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5831:1876474454933632:192.168.201.16@tcp:105: 00010000:00010000:2.0:1789545726.184886:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789545726.184962:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd9366850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a8edb7a-f384-4468-93f4-9d664f284862+6:2358:x1876474438132224:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 15889us (16072us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545726.184974:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 42 00000100:00100000:3.0:1789545726.191576:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438132352 00000100:00100000:3.0:1789545726.191589:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438132352 00002000:00100000:3.0:1789545726.191655:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff994be4798380 x1876474438132352/t0(0) o4->8a8edb7a-f384-4468-93f4-9d664f284862@192.168.201.16@tcp:192/0 lens 504/0 e 0 to 0 dl 1789545737 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789545726.191667:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994be4798380 with x1876474438132352 ext(0->8) 00002000:00010000:3.0:1789545726.191673:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff994be4798380 00000100:00100000:3.0:1789545726.191822:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 0 00000100:00100000:3.0:1789545726.191834:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8a8edb7a-f384-4468-93f4-9d664f284862+6:2358:x1876474438132352:12345-192.168.201.16@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789545726.194873:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8a8edb7a-f384-4468-93f4-9d664f284862+8:2358:x1876474438132352:12345-192.168.201.16@tcp:4:lhsmtool_posix.0 Request processed in 3034us (10112us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789545726.194895:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 0 00002000:00100000:3.0:1789545726.194909:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff994be4798380 x1876474438132352/t4294967302(0) o4->8a8edb7a-f384-4468-93f4-9d664f284862@192.168.201.16@tcp:192/0 lens 504/448 e 0 to 0 dl 1789545737 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789545726.194920:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994be4798380 with x1876474438132352 ext(0->8) 00002000:00010000:3.0:1789545726.194927:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff994be4798380 00000100:00100000:0.0:1789545726.198254:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545726.198325:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438132480 00000100:00100000:3.0:1789545726.198335:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438132480 00000100:00100000:3.0:1789545726.200529:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 80 00000100:00100000:3.0:1789545726.200548:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be479bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+29:10481:x1876474438132480:12345-192.168.201.16@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1789545726.269762:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be479bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+29:10481:x1876474438132480:12345-192.168.201.16@tcp:44:lhsmtool_posix.0 Request processed in 69208us (71503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545726.269776:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 80 00000001:00080000:2.0:1789545726.269816:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:2.0:1789545726.269840:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:2.0:1789545726.269864:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1789545726.270076:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1789545726.270092:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1789545726.272588:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454933760:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789545726.272657:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545726.272729:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454933760 00000100:00100000:2.0:1789545726.272736:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454933760 00000100:00100000:2.0:1789545726.272788:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789545726.272796:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454933760:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789545726.272952:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789545726.272955:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789545726 00002000:00010000:2.0:1789545726.272958:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789545726.272960:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789545726 -> 1789545726 00002000:00010000:2.0:1789545726.272962:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789545726.272999:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1876474454933760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 203us (342us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789545726.273007:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1789545726.273027:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789545726.273057:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff994bdfb1bb80/2, rc 0, transno 4294967303 00000100:00100000:2.0:1789545726.273062:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454933760:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789545726.276539:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545726.276584:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438132608 00000100:00100000:2.0:1789545726.276594:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438132608 00000100:00100000:2.0:1789545726.276643:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 30 00000100:00100000:2.0:1789545726.276653:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+8:2359:x1876474438132608:12345-192.168.201.16@tcp:16:lhsmtool_posix.0 00000040:00080000:3.0:1789545726.280829:0:12012:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789545726.280839:0:12012:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789545726.280879:0:12012:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789545726.280885:0:12012:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789545726.333607:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+8:2359:x1876474438132608:12345-192.168.201.16@tcp:16:lhsmtool_posix.0 Request processed in 56946us (57067us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545726.333620:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 30 00000001:00080000:2.0:1789545726.333665:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1789545726.333676:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:2.0:1789545726.340304:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545726.340671:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438132864 00000100:00100000:0.0:1789545726.340682:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438132864 00000100:00100000:0.0:1789545726.340740:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 81 00000100:00100000:0.0:1789545726.340751:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+13:10481:x1876474438132864:12345-192.168.201.16@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789545726.340807:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789545726.340842:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ba2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54ff expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.340859:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff994bc4ffec00) 00010000:00010000:0.0:1789545726.340866:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789545726.340896:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0bb7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.340911:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0bb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.340921:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0bb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789545726.341260:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a05632f4 reply state 00000000d0de78d4 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0bb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545726.341329:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789545726.341645:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+14:10481:x1876474438132864:12345-192.168.201.16@tcp:36:lhsmtool_posix.0 Request processed in 894us (1349us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1789545726.341653:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 81 00000100:00100000:1.0:1789545726.350410:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:2.0:1789545726.350548:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0bb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545726.350562:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0bb7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545726.350569:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0bb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545726.350576:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6600 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545726.350581:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0bb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545726.350588:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0bb7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545726.350606:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff994bc4ffec00) 00010000:00010000:2.0:1789545726.350609:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545726.350614:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0bb7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545726.350620:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0bb7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545726.350658:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438132992 00000100:00100000:2.0:1789545726.350667:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438132992 00000100:00100000:2.0:1789545726.350735:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 31 00000100:00100000:2.0:1789545726.350744:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+6:2361:x1876474438132992:12345-192.168.201.16@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789545726.350979:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789545726.350991:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789545726 -> 1789545725 00002000:00010000:2.0:1789545726.350994:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789545723 00002000:00010000:2.0:1789545726.350995:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789545726 -> 1789545725 00002000:00010000:2.0:1789545726.350998:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789545726.351047:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+7:2361:x1876474438132992:12345-192.168.201.16@tcp:2:lhsmtool_posix.0 Request processed in 304us (647us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789545726.351054:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 31 00000100:00100000:2.0:1789545726.358850:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545726.358919:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438133248 00000100:00100000:1.0:1789545726.358928:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438133248 00000100:00100000:1.0:1789545726.358986:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 82 00000100:00100000:1.0:1789545726.358995:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+13:10481:x1876474438133248:12345-192.168.201.16@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789545726.359068:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0bbe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545726.359085:0:10125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c0b7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54f1 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545726.359094:0:10125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0bbe lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545726.359126:0:10125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c0b7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54f1 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545726.359723:0:10125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c0b7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54f1 expref: 13 pid: 5848 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545726.359739:0:10125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994beddf1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1876474454933888:192.168.201.16@tcp:104: 00000100:00100000:1.0:1789545726.359831:0:10125:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8c2ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1789545726.369643:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545726.369707:0:10125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994beddf1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1876474454933888:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545726.369736:0:10125:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0bbe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545726.373525:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438133376 00000100:00100000:1.0:1789545726.373540:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438133376 00010000:00010000:1.0:1789545726.373586:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c0b7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54f1 expref: 14 pid: 5848 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545726.373629:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 43 00000100:00100000:1.0:1789545726.373640:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4941880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a8edb7a-f384-4468-93f4-9d664f284862+14:2359:x1876474438133376:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789545726.373653:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545726.373661:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c0b7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54f1 expref: 14 pid: 5848 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545726.373675:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c0b7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54f1 expref: 14 pid: 5848 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545726.373697:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c0b7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54f1 expref: 14 pid: 5848 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545726.373712:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff994bc4ffec00) 00010000:00010000:1.0:1789545726.373717:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0bbe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545726.373739:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0bbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545726.373747:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0bbe lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545726.373772:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789545726.373839:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4941880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a8edb7a-f384-4468-93f4-9d664f284862+13:2359:x1876474438133376:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 200us (4206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545726.373847:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 43 00010000:00010000:3.0:1789545726.375968:0:10125:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0bbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.375983:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0bbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.376013:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0bbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.376031:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0bbe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.376038:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0bbe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.376043:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba8400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545726.376047:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0bbe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.376054:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0bbe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.376069:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff994bc4ffec00) 00010000:00010000:3.0:1789545726.376071:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789545726.376076:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0bbe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.376082:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0bbe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545726.376173:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+12:10481:x1876474438133248:12345-192.168.201.16@tcp:55:lhsmtool_posix.0 Request processed in 17176us (17330us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789545726.376183:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 82 00000100:00100000:3.0:1789545726.379063:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545726.379350:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438133504 00000100:00100000:1.0:1789545726.379388:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438133504 00000100:00100000:1.0:1789545726.379447:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 32 00000100:00100000:1.0:1789545726.379458:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4943b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a8edb7a-f384-4468-93f4-9d664f284862+7:2360:x1876474438133504:12345-192.168.201.16@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789545726.379508:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000877addff/0x64919c0f856c0bc5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545726.379527:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c5ccc237/0x64919c0f856c0bb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de550d expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545726.379536:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789545726.379540:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789545726.379545:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000877addff/0x64919c0f856c0bc5 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545726.379580:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c5ccc237/0x64919c0f856c0bb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de550d expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545726.379615:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c5ccc237/0x64919c0f856c0bb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de550d expref: 7 pid: 6692 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545726.379631:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994beddf3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1876474454934016:192.168.201.16@tcp:104: 00000100:00100000:1.0:1789545726.379708:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8c2eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789545726.391151:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545726.391263:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994beddf3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1876474454934016:192.168.201.16@tcp:104: 00010000:00010000:1.0:1789545726.391308:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000877addff/0x64919c0f856c0bc5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545726.391646:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438133632 00000100:00100000:0.0:1789545726.391654:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438133632 00010000:00010000:0.0:1789545726.391694:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c5ccc237/0x64919c0f856c0bb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de550d expref: 8 pid: 6692 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545726.391748:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 44 00000100:00100000:0.0:1789545726.391758:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4941500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a8edb7a-f384-4468-93f4-9d664f284862+8:2358:x1876474438133632:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789545726.391774:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789545726.391810:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c5ccc237/0x64919c0f856c0bb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de550d expref: 8 pid: 6692 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.391823:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c5ccc237/0x64919c0f856c0bb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de550d expref: 8 pid: 6692 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.391849:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5ccc237/0x64919c0f856c0bb0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de550d expref: 8 pid: 6692 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.391866:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789545726.391871:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789545726.391876:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000877addff/0x64919c0f856c0bc5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.391886:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000877addff/0x64919c0f856c0bc5 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.391914:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789545726.391979:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4941500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a8edb7a-f384-4468-93f4-9d664f284862+7:2358:x1876474438133632:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 222us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545726.391987:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 44 00010000:00010000:0.0:1789545726.392102:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000877addff/0x64919c0f856c0bc5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.392111:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000877addff/0x64919c0f856c0bc5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.392156:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000877addff/0x64919c0f856c0bc5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.392166:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000877addff/0x64919c0f856c0bc5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.392174:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000877addff/0x64919c0f856c0bc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.392182:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba9000 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:0.0:1789545726.392186:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000877addff/0x64919c0f856c0bc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.392195:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000877addff/0x64919c0f856c0bc5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.392207:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000877addff/0x64919c0f856c0bc5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.392214:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000877addff/0x64919c0f856c0bc5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545726.392263:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4943b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a8edb7a-f384-4468-93f4-9d664f284862+6:2360:x1876474438133504:12345-192.168.201.16@tcp:1:lhsmtool_posix.0 Request processed in 12807us (13208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545726.393255:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 32 00000100:00100000:3.0:1789545726.397951:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545726.400586:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438133888 00000100:00100000:0.0:1789545726.400600:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438133888 00000100:00100000:0.0:1789545726.400669:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 83 00000100:00100000:0.0:1789545726.400680:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+12:10481:x1876474438133888:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789545726.400756:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0bcc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.400772:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0bcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.400784:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0bcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.400977:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0bd3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.400989:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0b8d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54f8 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.400997:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0bd3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.401030:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0b8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54f8 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.401042:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0b8d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54f8 expref: 13 pid: 5848 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545726.401056:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4799880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876474454934144:192.168.201.16@tcp:104: 00000100:00100000:0.0:1789545726.401138:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdf6049c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789545726.404699:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4799880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876474454934144:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545726.404734:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0bd3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545726.411505:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545726.411668:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438134016 00000100:00100000:1.0:1789545726.411678:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438134016 00010000:00010000:1.0:1789545726.411720:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0b8d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54f8 expref: 14 pid: 5848 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545726.411750:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 45 00000100:00100000:1.0:1789545726.411760:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a8edb7a-f384-4468-93f4-9d664f284862+14:2358:x1876474438134016:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789545726.411772:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545726.411778:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0b8d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54f8 expref: 14 pid: 5848 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545726.411789:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0b8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54f8 expref: 14 pid: 5848 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545726.411809:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0b8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54f8 expref: 14 pid: 5848 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545726.411829:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff994bc4ffec00) 00010000:00010000:1.0:1789545726.411833:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0bd3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545726.411842:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0bd3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545726.411850:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0bd3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545726.411885:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789545726.411930:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a8edb7a-f384-4468-93f4-9d664f284862+13:2358:x1876474438134016:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 171us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545726.411937:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 45 00010000:00010000:2.0:1789545726.412103:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0bd3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545726.412111:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0bd3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789545726.412460:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1789545726.412612:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1789545726.412652:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1789545726.412719:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb1aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5847:1876474454934272:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789545726.412764:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545726.412805:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8ce6900 going to sleep for 11 seconds 00000100:00100000:0.0:1789545726.413348:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454934272 00000100:00100000:0.0:1789545726.413383:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454934272 00000100:00100000:0.0:1789545726.413428:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789545726.413437:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1876474454934272:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789545726.413511:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1876474454934272:12345-0@lo:1000:mdt00_001.0 Request processed in 76us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545726.413518:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789545726.413702:0:5847:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1789545726.413707:0:5847:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff994bdfb1bb80, transno 4294967303 00000100:00100000:2.0:1789545726.413725:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb1aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5847:1876474454934272:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1789545726.414196:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1789545726.414260:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb1aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5847:1876474454934400:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789545726.414308:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545726.414331:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8ce66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789545726.414747:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454934400 00000100:00100000:0.0:1789545726.414754:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454934400 00000100:00100000:0.0:1789545726.414800:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789545726.414809:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1876474454934400:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789545726.414978:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5847:x1876474454934400:12345-0@lo:1000:mdt00_001.0 Request processed in 170us (668us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789545726.414986:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789545726.415025:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb1aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5847:1876474454934400:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1789545726.415056:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0bd3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.415066:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0bd3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.415073:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0bd3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.415080:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb7800 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545726.415085:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0bd3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.415093:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0bd3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.415115:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff994bc4ffec00) 00010000:00010000:0.0:1789545726.415118:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789545726.415124:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0bd3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.415145:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0bd3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.415181:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0b08 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.415188:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0b08 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.415194:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0b08 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.415199:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba8800 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545726.415202:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0b08 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.415208:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0b08 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.415216:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe400) 00010000:00010000:0.0:1789545726.415219:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789545726.415222:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0b08 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.415228:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0b08 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.415256:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0bda lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.415419:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0b24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54dc expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.415430:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0bda lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.415455:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0b24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54dc expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.415468:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0b24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54dc expref: 16 pid: 5846 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545726.415481:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be479b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876474454934528:192.168.201.16@tcp:104: 00000100:00100000:0.0:1789545726.415540:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdf604240 going to sleep for 11 seconds 00000100:00100000:2.0:1789545726.423016:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545726.425746:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be479b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876474454934528:192.168.201.16@tcp:104: 00010000:00010000:0.0:1789545726.425780:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0bda lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545726.426427:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438134144 00000100:00100000:3.0:1789545726.426437:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438134144 00010000:00010000:3.0:1789545726.426480:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0b24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54dc expref: 17 pid: 5846 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545726.426517:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 46 00000100:00100000:3.0:1789545726.426527:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+17:2358:x1876474438134144:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789545726.426542:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545726.426549:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0b24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54dc expref: 17 pid: 5846 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.426562:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0b24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54dc expref: 17 pid: 5846 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.426584:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0b24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de54dc expref: 17 pid: 5846 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.426600:0:7637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe400) 00010000:00010000:3.0:1789545726.426605:0:7637:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0bda lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.426615:0:7637:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0bda lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.426623:0:7637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0bda lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545726.426645:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545726.426707:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+16:2358:x1876474438134144:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 181us (3699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545726.426715:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 46 00010000:00010000:0.0:1789545726.426919:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0bda lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.426927:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0bda lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.426938:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0bda lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.426951:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0bda lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.426958:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0bda lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.426964:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545726.426968:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0bda lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.426975:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0bda lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.426983:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe400) 00010000:00010000:0.0:1789545726.426986:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545726.426989:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0bda lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.426995:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0bda lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.427006:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0bcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.427012:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0bcc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.427017:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0bcc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.427022:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545726.427030:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0bcc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.427036:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0bcc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.427044:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4ffe400) 00010000:00010000:0.0:1789545726.427047:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789545726.427049:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0bcc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545726.427054:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0bcc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545726.427553:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+15:10481:x1876474438133888:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 Request processed in 26589us (29326us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1789545726.427565:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 83 00000020:00080000:0.0:1789545726.427569:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789545726.427930:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789545726.427934:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789545726.427970:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789545726.427976:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789545726.429807:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545726.429873:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438134400 00000100:00100000:1.0:1789545726.429883:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438134400 00000100:00100000:1.0:1789545726.429938:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 20 00000100:00100000:1.0:1789545726.429957:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+15:10481:x1876474438134400:12345-192.168.201.16@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789545726.430777:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789545726.430870:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1789545726.430912:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c0be1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545726.430927:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c0be1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545726.430938:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c0be1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545726.430956:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c0be1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545726.430963:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c0be1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545726.430968:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c0be1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545726.430989:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789545726.431141:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+17:10481:x1876474438134400:12345-192.168.201.16@tcp:35:lhsmtool_posix.0 Request processed in 1192us (1340us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1789545726.431150:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 20 00000020:00080000:1.0:1789545726.431155:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789545726.431230:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789545726.431238:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c0be1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545726.431244:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba8200 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:2.0:1789545726.431248:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c0be1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545726.431256:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c0be1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545726.431278:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff994bc4ffe100) 00010000:00010000:2.0:1789545726.431281:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789545726.431286:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c0be1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545726.431292:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c0be1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545726.431310:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545726.431312:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545726.431314:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545726.780743:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545727.810650:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789545728.163047:0:12065:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789545728.163058:0:12065:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789545728.163096:0:12065:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789545728.163103:0:12065:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789545728.350148:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545728.350294:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438134656 00000100:00100000:2.0:1789545728.350304:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438134656 00000100:00100000:2.0:1789545728.350420:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 84 00000100:00100000:2.0:1789545728.350431:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be479b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+17:10499:x1876474438134656:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:2.0:1789545728.350459:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545728.350480:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0be8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5514 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.350612:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c0bef lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.350628:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c0bef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.350642:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c0bef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545728.350653:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789545728.350789:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0be8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5514 expref: 20 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.350809:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c0bef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5514 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.350818:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:2.0:1789545728.350820:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789545728.350824:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1600, rc 0) 00000100:00100000:2.0:1789545728.350882:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be479b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+19:10499:x1876474438134656:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 454us (752us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1789545728.350891:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 84 00000100:00080000:3.0:1789545728.352164:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789545728.355246:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545728.356471:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438134784 00000100:00100000:3.0:1789545728.356483:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438134784 00000100:00100000:3.0:1789545728.356551:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 85 00000100:00100000:3.0:1789545728.356564:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+19:10499:x1876474438134784:12345-192.168.201.16@tcp:34:lfs.0 00010000:00010000:3.0:1789545728.356644:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0bfd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.356663:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0bfd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.356675:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0bfd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.356692:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0c04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.356699:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0c04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.356705:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0c04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.357613:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0c0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.357632:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0c0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.357641:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0c0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789545728.357687:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0c0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.357699:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0bfd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.357705:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0bfd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.357712:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0bfd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.357718:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217f000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545728.357723:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0bfd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.357731:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0bfd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.357743:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:3.0:1789545728.357747:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545728.357752:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0bfd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.357758:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0bfd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.357777:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0c04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.357783:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0c04 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.357789:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0c04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.357794:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217fe00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545728.357797:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0c04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.357803:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0c04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.357809:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff994bc4f9e500) 00010000:00010000:3.0:1789545728.357812:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545728.357815:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0c04 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.357821:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0c04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.357835:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0c0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.357840:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0c0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.357846:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0c0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.357856:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217f600 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545728.357859:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0c0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.357865:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0c0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.357873:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4f9e600) 00010000:00010000:3.0:1789545728.357875:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545728.357878:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0c0b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.357884:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0c0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545728.357992:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+19:10499:x1876474438134784:12345-192.168.201.16@tcp:34:lfs.0 Request processed in 1429us (2753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545728.358001:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 85 00000100:00100000:2.0:1789545728.428218:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545728.434425:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438135040 00000100:00100000:3.0:1789545728.434443:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438135040 00000100:00100000:3.0:1789545728.434512:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 86 00000100:00100000:3.0:1789545728.434522:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+19:10502:x1876474438135040:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:3.0:1789545728.434544:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545728.434565:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0c12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de551b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.434634:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0c19 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.434666:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0c19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.434678:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0c19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.434694:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0c20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.434701:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0c20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.434708:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0c20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.434952:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0c27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.434961:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0c27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.434968:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0c27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545728.434978:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789545728.435069:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0c19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.435077:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0c19 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.435083:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0c19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.435095:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217fe00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545728.435100:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0c19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.435107:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0c19 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.435120:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:3.0:1789545728.435123:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545728.435128:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0c19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.435134:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0c19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.435147:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0c20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.435153:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0c20 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.435159:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0c20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.435164:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217f000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545728.435167:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0c20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.435173:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0c20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.435192:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff994bc4f9e600) 00010000:00010000:3.0:1789545728.435194:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545728.435197:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0c20 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.435203:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0c20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.435247:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0c12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de551b expref: 22 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.435260:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0c27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de551b expref: 21 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.435267:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4f9e500) 00010000:00010000:3.0:1789545728.435269:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789545728.435271:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217f400, rc 0) 00000100:00100000:3.0:1789545728.435355:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+21:10502:x1876474438135040:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 834us (7146us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789545728.435393:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 86 00000100:00100000:2.0:1789545728.441787:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545728.442085:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438135168 00000100:00100000:0.0:1789545728.442096:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438135168 00000100:00100000:0.0:1789545728.442159:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 87 00000100:00100000:0.0:1789545728.442170:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+21:10502:x1876474438135168:12345-192.168.201.16@tcp:54:lfs.0 00010000:00010000:0.0:1789545728.442237:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0c35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545728.442273:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0c35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545728.442285:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0c35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545728.442313:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0c35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545728.442320:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0c35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545728.442327:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0c35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545728.442343:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb7000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545728.442347:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0c35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545728.442354:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0c35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545728.442399:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4f9e500) 00010000:00010000:0.0:1789545728.442402:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789545728.442407:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0c35 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545728.442413:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0c35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545728.442583:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+21:10502:x1876474438135168:12345-192.168.201.16@tcp:54:lfs.0 Request processed in 413us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545728.442602:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 87 00000100:00100000:2.0:1789545728.445452:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545728.445595:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438135424 00000100:00100000:3.0:1789545728.445606:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438135424 00000100:00100000:3.0:1789545728.445666:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 21 00000100:00100000:3.0:1789545728.445676:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+21:10502:x1876474438135424:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:3.0:1789545728.445935:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+22:10502:x1876474438135424:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 260us (493us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789545728.445943:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 21 00000100:00100000:0.0:1789545728.523781:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545728.523906:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438135680 00000100:00100000:3.0:1789545728.523918:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438135680 00000100:00100000:3.0:1789545728.523981:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 88 00000100:00100000:3.0:1789545728.524001:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be479aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+22:10021:x1876474438135680:12345-192.168.201.16@tcp:101:bash.0 00010000:00010000:3.0:1789545728.524028:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545728.524051:0:10125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0c3c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5522 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.524159:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0c43 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.524174:0:10125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0c27 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de551b expref: 23 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.524183:0:10125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0c43 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.524216:0:10125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0c27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de551b expref: 23 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.524229:0:10125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0c27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de551b expref: 23 pid: 5848 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545728.524243:0:10125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4940a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1876474454934656:192.168.201.16@tcp:104: 00000100:00100000:3.0:1789545728.524345:0:10125:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfae0540 going to sleep for 11 seconds 00000100:00100000:2.0:1789545728.528566:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545728.528659:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438135808 00000100:00100000:0.0:1789545728.528670:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438135808 00010000:00010000:0.0:1789545728.528714:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0c27 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de551b expref: 24 pid: 5848 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545728.528761:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 47 00000100:00100000:0.0:1789545728.528771:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+24:2358:x1876474438135808:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789545728.528787:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789545728.528795:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0c27 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de551b expref: 24 pid: 5848 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545728.528809:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0c27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de551b expref: 24 pid: 5848 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545728.528832:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4f9e500) 00010000:00010000:0.0:1789545728.528837:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0c43 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545728.528847:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0c43 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545728.528855:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0c43 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545728.528873:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789545728.528931:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+24:2358:x1876474438135808:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 162us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545728.528940:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 47 00010000:00010000:3.0:1789545728.530714:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0c27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de551b expref: 23 pid: 5848 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545728.530741:0:10125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4940a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1876474454934656:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545728.530779:0:10125:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0c43 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.530788:0:10125:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0c43 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.530793:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0c43 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545728.530813:0:10125:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789545728.530962:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0c3c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5522 expref: 24 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.530977:0:10125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0c43 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5522 expref: 23 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.530998:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4f9e500) 00010000:00010000:3.0:1789545728.531001:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789545728.531004:0:10125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217f000, rc 0) 00000100:00100000:3.0:1789545728.531111:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be479aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+23:10021:x1876474438135680:12345-192.168.201.16@tcp:101:bash.0 Request processed in 7112us (7338us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1789545728.531121:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 88 00000100:00100000:2.0:1789545728.535750:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545728.535837:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438136064 00000100:00100000:3.0:1789545728.535849:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438136064 00000100:00100000:3.0:1789545728.535912:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 89 00000100:00100000:3.0:1789545728.535924:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+23:10021:x1876474438136064:12345-192.168.201.16@tcp:36:bash.0 00010000:00010000:3.0:1789545728.536210:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0c51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.536245:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0c51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.536258:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0c51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789545728.536316:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1789545728.536393:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000154f1342 reply state 00000000676ffb84 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0c51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545728.536403:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789545728.536454:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1789545728.536557:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+27:10021:x1876474438136064:12345-192.168.201.16@tcp:36:bash.0 Request processed in 635us (818us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1789545728.536565:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 89 00000020:00080000:3.0:1789545728.536569:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1789545728.538005:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0c51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.538019:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0c51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.538027:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0c51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.538033:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217fe00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545728.538038:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0c51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.538046:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0c51 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.538078:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4f9e500) 00010000:00010000:3.0:1789545728.538081:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545728.538087:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0c51 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.538093:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0c51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545728.546403:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545728.546682:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438136192 00000100:00100000:3.0:1789545728.546692:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438136192 00000100:00100000:2.0:1789545728.546873:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 90 00000100:00100000:2.0:1789545728.546885:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+26:10021:x1876474438136192:12345-192.168.201.16@tcp:101:bash.0 00010000:00010000:2.0:1789545728.546918:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545728.546937:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0c58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5529 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.547009:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0c58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5529 expref: 27 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.547026:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0c58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5529 expref: 27 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.547047:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4f9e500) 00010000:00010000:2.0:1789545728.547050:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789545728.547055:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0c00, rc 0) 00000100:00100000:2.0:1789545728.547118:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+27:10021:x1876474438136192:12345-192.168.201.16@tcp:101:bash.0 Request processed in 234us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545728.547125:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 90 00000100:00100000:1.0:1789545728.554471:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545728.554601:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438136320 00000100:00100000:2.0:1789545728.554612:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438136320 00000100:00100000:2.0:1789545728.554719:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 33 00000100:00100000:2.0:1789545728.554745:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+6:10021:x1876474438136320:12345-192.168.201.16@tcp:101:bash.0 00010000:00010000:2.0:1789545728.554763:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545728.554787:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c0c5f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5530 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789545728.554815:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aaa4cfd, atime: 0x6aaa4cfb, ctime: 0x6aaa4cfd, blocks: 0xb 00010000:00010000:2.0:1789545728.554838:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=342s v=(0 0) 00010000:00010000:2.0:1789545728.554843:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545728.554851:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c0c5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5530 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.554871:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c0c5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5530 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.554883:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1c00, rc 0) 00000100:00100000:2.0:1789545728.554940:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+7:10021:x1876474438136320:12345-192.168.201.16@tcp:101:bash.0 Request processed in 198us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545728.554948:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 33 00000100:00080000:3.0:1789545728.555013:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789545728.559584:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545728.559677:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438136448 00000100:00100000:2.0:1789545728.559687:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438136448 00002000:00010000:2.0:1789545728.559731:0:6696:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1789545728.559736:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994be479b480 with x1876474438136448 ext(0->18446744073709551615) 00002000:00010000:2.0:1789545728.559747:0:6696:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff994be479b480. 00000100:00100000:2.0:1789545728.559789:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1 00000100:00100000:2.0:1789545728.559799:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be479b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8a8edb7a-f384-4468-93f4-9d664f284862+7:2360:x1876474438136448:12345-192.168.201.16@tcp:10:bash.0 00002000:00010000:2.0:1789545728.560103:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789545728.560112:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789545725 -> 1789545728 00002000:00010000:2.0:1789545728.560115:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1789545723 -> 1789545723 00002000:00010000:2.0:1789545728.560117:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789545725 -> 1789545728 00002000:00010000:2.0:1789545728.560119:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789545728.560175:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be479b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8a8edb7a-f384-4468-93f4-9d664f284862+8:2360:x1876474438136448:12345-192.168.201.16@tcp:10:bash.0 Request processed in 377us (601us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789545728.560183:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1 00002000:00010000:2.0:1789545728.560187:0:6696:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1789545728.560190:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994be479b480 with x1876474438136448 ext(0->18446744073709551615) 00002000:00010000:2.0:1789545728.560623:0:6696:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff994be479b480. 00000100:00100000:0.0:1789545728.574834:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bffcdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876474454935040:0@lo:400:kworker.0 00000100:00100000:0.0:1789545728.574898:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545728.574935:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789545728.574940:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bffcd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876474454934912:0@lo:400:kworker.0 00000100:00100000:0.0:1789545728.574957:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545728.574969:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bffcd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454935424:0@lo:400:kworker.0 00000100:00100000:0.0:1789545728.574988:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545728.575014:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454935040 00000100:00100000:0.0:1789545728.575021:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454935040 00000100:00100000:0.0:1789545728.575066:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454934912 00000100:00100000:0.0:1789545728.575068:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454934912 00000100:00100000:0.0:1789545728.575084:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789545728.575091:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bffcd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876474454935040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545728.575148:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bffcd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876474454935040:12345-0@lo:400:kworker.0 Request processed in 57us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545728.575155:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789545728.575170:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789545728.575176:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bffcdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876474454934912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545728.575198:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bffcdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876474454934912:12345-0@lo:400:kworker.0 Request processed in 23us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545728.575203:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:0.0:1789545728.575216:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789545728.575244:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bffcd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876474454934912:0@lo:400:kworker.0 00000100:00100000:0.0:1789545728.575254:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bffcdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876474454935040:0@lo:400:kworker.0 00000100:00100000:0.0:1789545728.575309:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454935424 00000100:00100000:0.0:1789545728.575312:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454935424 00000100:00100000:0.0:1789545728.575376:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789545728.575383:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bffcd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1876474454935424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545728.575415:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bffcd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1876474454935424:12345-0@lo:400:kworker.0 Request processed in 33us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545728.575420:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1789545728.575435:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789545728.575449:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bffcd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454935424:0@lo:400:kworker.0 00000100:00100000:2.0:1789545728.580792:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454934784:0@lo:400:kworker.0 00000100:00100000:2.0:1789545728.580885:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545728.580942:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bffcd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454935296:0@lo:400:kworker.0 00000100:00100000:2.0:1789545728.580973:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545728.581014:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789545728.581022:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bffcd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454935168:0@lo:400:kworker.0 00000100:00100000:2.0:1789545728.581046:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545728.581085:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454935168 00000100:00100000:2.0:1789545728.581093:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454935168 00000100:00100000:2.0:1789545728.581163:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789545728.581173:0:8211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1876474454935168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545728.581226:0:8211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1876474454935168:12345-0@lo:400:kworker.0 Request processed in 55us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545728.581232:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1789545728.581256:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789545728.581288:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bffcd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454935168:0@lo:400:kworker.0 00000100:00100000:2.0:1789545728.581345:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454935296 00000100:00100000:2.0:1789545728.581349:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454935296 00000100:00100000:2.0:1789545728.581420:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789545728.581427:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454935296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545728.581464:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454935296:12345-0@lo:400:kworker.0 Request processed in 37us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545728.581469:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1789545728.581483:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789545728.581500:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bffcd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454935296:0@lo:400:kworker.0 00000100:00100000:1.0:1789545728.581668:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454934784 00000100:00100000:1.0:1789545728.581674:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454934784 00000100:00100000:1.0:1789545728.581716:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789545728.581724:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3312:x1876474454934784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545728.581767:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3312:x1876474454934784:12345-0@lo:400:kworker.0 Request processed in 44us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545728.581773:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789545728.581811:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454934784:0@lo:400:kworker.0 00000001:00080000:1.0:1789545728.625588:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:1.0:1789545728.625685:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:0.0:1789545728.639879:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545728.640100:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438136576 00000100:00100000:2.0:1789545728.640111:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438136576 00000100:00100000:2.0:1789545728.640242:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 91 00000100:00100000:2.0:1789545728.640253:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bffcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+27:10516:x1876474438136576:12345-192.168.201.16@tcp:34:lfs.0 00010000:00010000:2.0:1789545728.640350:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0c66 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.640411:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0c66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.640423:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0c66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.640439:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0c6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.640446:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0c6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.640452:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0c6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.640721:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0c74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.640732:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0c74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.640740:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0c74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789545728.640780:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0c74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.640792:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0c66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.640799:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0c66 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.640805:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0c66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.640811:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545728.640815:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0c66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.640822:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0c66 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.640834:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:2.0:1789545728.640837:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545728.640842:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0c66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.640855:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0c66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.640867:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0c6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.640873:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0c6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.640879:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0c6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.640884:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0a00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545728.640887:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0c6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.640893:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0c6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.640902:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff994bcd248c00) 00010000:00010000:2.0:1789545728.640904:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545728.641464:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0c6d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.641475:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0c6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.641493:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0c74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.641499:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0c74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.641513:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0c74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.641527:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545728.641530:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0c74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.641537:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0c74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.641546:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4f9e500) 00010000:00010000:2.0:1789545728.641548:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545728.641551:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0c74 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.641557:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0c74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545728.641770:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bffcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+27:10516:x1876474438136576:12345-192.168.201.16@tcp:34:lfs.0 Request processed in 1515us (1898us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545728.641779:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 91 00000100:00100000:1.0:1789545728.685873:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545728.685974:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438136832 00000100:00100000:2.0:1789545728.685986:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438136832 00000100:00100000:2.0:1789545728.686055:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 92 00000100:00100000:2.0:1789545728.686067:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+27:10519:x1876474438136832:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:2.0:1789545728.686089:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545728.686111:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0c7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5537 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.686198:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0c82 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.686225:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0c82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.686481:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0c82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.686497:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0c89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.686505:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0c89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.686511:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0c89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.686776:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0c90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.686786:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0c90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.686793:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0c90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545728.686802:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789545728.686902:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0c82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.686910:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0c82 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.686916:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0c82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.686922:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0a00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545728.686933:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0c82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.686943:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0c82 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.686956:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:2.0:1789545728.686959:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545728.686964:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0c82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.686970:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0c82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.686982:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0c89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.686988:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0c89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.686994:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0c89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.686999:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545728.687001:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0c89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.687006:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0c89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.687013:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff994bcd248c00) 00010000:00010000:2.0:1789545728.687015:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545728.687025:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0c89 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.687030:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0c89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.687072:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0c7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5537 expref: 30 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.687089:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0c90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5537 expref: 29 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.687095:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4f9e500) 00010000:00010000:2.0:1789545728.687098:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789545728.687100:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0200, rc 0) 00000100:00100000:2.0:1789545728.687171:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+29:10519:x1876474438136832:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 1105us (1309us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1789545728.687181:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 92 00000100:00100000:2.0:1789545728.708747:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545728.708860:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438136960 00000100:00100000:0.0:1789545728.708872:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438136960 00000100:00100000:0.0:1789545728.708934:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 93 00000100:00100000:0.0:1789545728.708945:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+29:10519:x1876474438136960:12345-192.168.201.16@tcp:54:lfs.0 00010000:00010000:0.0:1789545728.709022:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0c9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545728.709041:0:10125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0c43 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5522 expref: 29 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545728.709050:0:10125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0c9e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545728.709088:0:10125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0c43 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5522 expref: 29 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545728.709101:0:10125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0c43 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5522 expref: 29 pid: 10125 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545728.709116:0:10125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bffcdb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1876474454935552:192.168.201.16@tcp:104: 00000100:00100000:0.0:1789545728.709253:0:10125:0:(client.c:2716:ptlrpc_set_wait()) set ffff994becff1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789545728.723112:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545728.723242:0:10125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bffcdb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1876474454935552:192.168.201.16@tcp:104: 00010000:00010000:2.0:1789545728.723272:0:10125:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0c9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545728.723418:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438137216 00000100:00100000:1.0:1789545728.723439:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438137216 00000100:00100000:1.0:1789545728.723498:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 22 00000100:00100000:1.0:1789545728.723529:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bffcd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+30:5594:x1876474438137216:12345-192.168.201.16@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789545728.723879:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bffcd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+31:5594:x1876474438137216:12345-192.168.201.16@tcp:35:ldlm_bl.0 Request processed in 370us (776us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1789545728.723887:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 22 00000100:00100000:1.0:1789545728.730393:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545728.730597:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438137344 00000100:00100000:0.0:1789545728.730608:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438137344 00010000:00010000:0.0:1789545728.730651:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0c43 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5522 expref: 31 pid: 10125 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545728.730695:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 48 00000100:00100000:0.0:1789545728.730706:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddf0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a8edb7a-f384-4468-93f4-9d664f284862+31:2359:x1876474438137344:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789545728.730721:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789545728.730729:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0c43 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5522 expref: 31 pid: 10125 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545728.730742:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0c43 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5522 expref: 31 pid: 10125 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545728.730765:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0c43 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5522 expref: 31 pid: 10125 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545728.730784:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4f9e500) 00010000:00010000:0.0:1789545728.730789:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0c9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545728.730798:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0c9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545728.730806:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0c9e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545728.732771:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789545728.732855:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddf0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a8edb7a-f384-4468-93f4-9d664f284862+30:2359:x1876474438137344:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 2147us (2503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545728.732866:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 48 00010000:00010000:2.0:1789545728.739019:0:10125:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0c9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.739038:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0c9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.739297:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0c9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.739309:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0c9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.739317:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0c9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.739332:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb7200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545728.739338:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0c9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.739346:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0c9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.739394:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4f9e500) 00010000:00010000:3.0:1789545728.739417:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789545728.739424:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0c9e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.739432:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0c9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545728.739535:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+29:10519:x1876474438136960:12345-192.168.201.16@tcp:54:lfs.0 Request processed in 30586us (30795us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545728.739545:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 93 00000100:00100000:3.0:1789545728.749871:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545728.749922:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438137600 00000100:00100000:1.0:1789545728.749934:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438137600 00000100:00100000:1.0:1789545728.750004:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 23 00000100:00100000:1.0:1789545728.750015:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+29:10519:x1876474438137600:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:1.0:1789545728.750278:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+30:10519:x1876474438137600:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 264us (415us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1789545728.750287:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 23 00010000:00010000:2.0:1789545728.829023:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545728.877225:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545728.877316:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438137856 00000100:00100000:2.0:1789545728.877345:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438137856 00000100:00100000:2.0:1789545728.877464:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 94 00000100:00100000:2.0:1789545728.877477:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+30:10530:x1876474438137856:12345-192.168.201.16@tcp:101:cat.0 00010000:00010000:2.0:1789545728.877504:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545728.877536:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0ca5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de553e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.877617:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0cac lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.877633:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0cac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.877644:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0cac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.877672:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0cb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.877680:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.877686:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.877968:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0cba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.877978:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0cba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.877998:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0cba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545728.878011:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1789545728.878110:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0cac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.878118:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0cac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.878125:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0cac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.878131:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545728.878136:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0cac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.878144:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0cac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.878157:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:2.0:1789545728.878160:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545728.878165:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0cac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.878171:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0cac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.878183:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.878190:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0cb3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.878202:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.878207:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545728.878210:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.878216:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0cb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.878224:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff994bcd248c00) 00010000:00010000:2.0:1789545728.878226:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545728.878229:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0cb3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.878234:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0cb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.878276:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0ca5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de553e expref: 33 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.878290:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0cba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de553e expref: 32 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.878813:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4f9e500) 00010000:00010000:2.0:1789545728.878816:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789545728.878819:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1200, rc 0) 00000100:00100000:2.0:1789545728.878895:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+32:10530:x1876474438137856:12345-192.168.201.16@tcp:101:cat.0 Request processed in 1420us (1679us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1789545728.878916:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 94 00000100:00100000:3.0:1789545728.884625:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545728.886019:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438138112 00000100:00100000:0.0:1789545728.886030:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438138112 00000100:00100000:0.0:1789545728.886129:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 24 00000100:00100000:0.0:1789545728.886152:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+32:10530:x1876474438138112:12345-192.168.201.16@tcp:35:cat.0 00000100:00100000:0.0:1789545728.886447:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+33:10530:x1876474438138112:12345-192.168.201.16@tcp:35:cat.0 Request processed in 309us (1831us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1789545728.886453:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 24 00000100:00100000:0.0:1789545728.911665:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545728.911745:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438138368 00000100:00100000:3.0:1789545728.911756:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438138368 00000100:00100000:3.0:1789545728.911816:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 95 00000100:00100000:3.0:1789545728.911827:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bffcd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+33:10531:x1876474438138368:12345-192.168.201.16@tcp:36:rm.0 00010000:00010000:3.0:1789545728.911890:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789545728.911928:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0cba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de553e expref: 33 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.911950:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0c90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5537 expref: 32 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.911963:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0c58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5529 expref: 31 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.911973:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4f9e500) 00010000:00010000:3.0:1789545728.911983:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789545728.912022:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0cc8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.912037:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0cc8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.912047:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0cc8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.912061:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ccf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.912069:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ccf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.912076:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ccf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.912310:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0cd6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.912346:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0cd6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.912353:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0cd6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789545728.912866:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1789545728.912876:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 342835515908ns, next at 343835513365ns, rc = 0 00010000:00010000:3.0:1789545728.912933:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0cdd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.912942:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0cdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.912956:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0cdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.912964:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0cdd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.912970:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0cdd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.912976:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0cdd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.913004:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789545728.913021:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0cd6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.913027:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0cd6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.913034:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0cd6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.913039:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217f400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545728.913043:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0cd6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.913050:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0cd6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.913060:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4f9e600) 00010000:00010000:3.0:1789545728.913063:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789545728.913071:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0cd6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.913078:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0cd6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.913095:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0cc8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.913101:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0cc8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.913107:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0cc8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.913112:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217fe00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545728.913114:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0cc8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.913120:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0cc8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.913126:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:3.0:1789545728.913128:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545728.913131:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0cc8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.913136:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0cc8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789545728.913144:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2f058f7 reply state 000000009acbcf88 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ccf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545728.913159:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789545728.913231:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bffcd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+32:10531:x1876474438138368:12345-192.168.201.16@tcp:36:rm.0 Request processed in 1405us (1575us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1789545728.913240:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 95 00010000:00010000:2.0:1789545728.913412:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789545728.913419:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0cdd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.913426:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217fc00 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:2.0:1789545728.913429:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0cdd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.913436:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0cdd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.913445:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994bc4f9e600) 00010000:00010000:2.0:1789545728.913447:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789545728.913449:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0cdd lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.913455:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0cdd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.913469:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545728.913470:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545728.913472:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545728.916871:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ccf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545728.916889:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ccf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545728.916897:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ccf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545728.916914:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217f600 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545728.916919:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ccf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545728.917116:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ccf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545728.917509:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff994bc4f9ee00) 00010000:00010000:1.0:1789545728.917512:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545728.917518:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ccf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545728.917524:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ccf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545728.972572:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545728.972775:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438138624 00000100:00100000:3.0:1789545728.972786:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438138624 00000100:00100000:3.0:1789545728.972851:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 96 00000100:00100000:3.0:1789545728.972862:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bffcd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+31:10538:x1876474438138624:12345-192.168.201.16@tcp:101:bash.0 00010000:00010000:3.0:1789545728.972885:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545728.972903:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0ce4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5545 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.973027:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0ceb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.973044:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0ceb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.973055:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0ceb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.973072:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0cf2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.973079:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0cf2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.973084:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0cf2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789545728.973708:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1789545728.973864:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0cf9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.973875:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.973882:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.973916:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0ceb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.973923:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0ceb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.973929:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0ceb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.973935:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217f400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545728.973940:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0ceb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.973948:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0ceb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.973959:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:3.0:1789545728.973962:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545728.973967:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0ceb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.973986:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0ceb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789545728.974000:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9d35f9b reply state 0000000013d044c4 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0cf2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545728.974008:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789545728.974038:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0ce4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5545 expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.974052:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0cf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5545 expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.974060:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f9ec00) 00010000:00010000:3.0:1789545728.974062:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789545728.974065:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217e400, rc 0) 00000100:00100000:3.0:1789545728.974138:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bffcd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+34:10538:x1876474438138624:12345-192.168.201.16@tcp:101:bash.0 Request processed in 1278us (1575us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1789545728.974146:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 96 00010000:00010000:3.0:1789545728.987469:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0cf2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.987489:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0cf2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.987497:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0cf2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.987504:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217fa00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545728.987529:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0cf2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.987537:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0cf2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.987555:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff994bc4f9e500) 00010000:00010000:3.0:1789545728.987558:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545728.987562:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0cf2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.987569:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0cf2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545728.987903:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545728.988705:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438138752 00000100:00100000:3.0:1789545728.988717:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438138752 00000100:00100000:3.0:1789545728.988801:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 34 00000100:00100000:3.0:1789545728.988812:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+5:2360:x1876474438138752:12345-192.168.201.16@tcp:101:bash.0 00010000:00010000:3.0:1789545728.988828:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545728.988846:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049165e55/0x64919c0f856c0d07 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de554c expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789545728.988871:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789545728.988889:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=342s v=(0 0) 00010000:00010000:3.0:1789545728.988893:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789545728.988912:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049165e55/0x64919c0f856c0d07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de554c expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.988933:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049165e55/0x64919c0f856c0d07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de554c expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545728.988956:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217f600, rc 0) 00000100:00100000:3.0:1789545728.989015:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+6:2360:x1876474438138752:12345-192.168.201.16@tcp:101:bash.0 Request processed in 205us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545728.989021:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 34 00000100:00080000:0.0:1789545728.989612:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789545728.994065:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545728.994180:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438138880 00000100:00100000:2.0:1789545728.994191:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438138880 00000100:00100000:2.0:1789545728.994271:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 35 00000100:00100000:2.0:1789545728.994281:0:8211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a8edb7a-f384-4468-93f4-9d664f284862+6:10538:x1876474438138880:12345-192.168.201.16@tcp:101:bash.0 00010000:00010000:2.0:1789545728.994309:0:8211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545728.994336:0:8211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048b2a4d9/0x64919c0f856c0d0e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5553 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.994424:0:8211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049165e55/0x64919c0f856c0d07 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de554c expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.994433:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545728.994437:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545728.994441:0:8211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048b2a4d9/0x64919c0f856c0d0e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5553 expref: 7 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.994474:0:8211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049165e55/0x64919c0f856c0d07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de554c expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545728.994488:0:8211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049165e55/0x64919c0f856c0d07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de554c expref: 7 pid: 6691 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545728.994501:0:8211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8211:1876474454935680:192.168.201.16@tcp:104: 00000100:00100000:2.0:1789545728.994593:0:8211:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc64d46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789545729.001506:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545729.001597:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438139008 00000100:00100000:0.0:1789545729.001607:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438139008 00010000:00010000:0.0:1789545729.001648:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049165e55/0x64919c0f856c0d07 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de554c expref: 8 pid: 6691 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545729.001693:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 49 00000100:00100000:0.0:1789545729.001703:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd9364c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a8edb7a-f384-4468-93f4-9d664f284862+8:2358:x1876474438139008:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789545729.001716:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789545729.001738:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049165e55/0x64919c0f856c0d07 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de554c expref: 8 pid: 6691 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.001772:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049165e55/0x64919c0f856c0d07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de554c expref: 8 pid: 6691 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.001798:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789545729.001804:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789545729.001812:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048b2a4d9/0x64919c0f856c0d0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5553 expref: 8 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.001823:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048b2a4d9/0x64919c0f856c0d0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5553 expref: 8 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.001863:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000048b2a4d9/0x64919c0f856c0d0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5553 expref: 8 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545729.001878:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bffcdad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5832:1876474454935808:192.168.201.16@tcp:105: 00000100:00100000:0.0:1789545729.001967:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff994becff1e40 going to sleep for 11 seconds 00010000:00010000:2.0:1789545729.002450:0:8211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049165e55/0x64919c0f856c0d07 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de554c expref: 8 pid: 6691 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545729.002467:0:8211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8211:1876474454935680:192.168.201.16@tcp:104: 00010000:00010000:2.0:1789545729.002490:0:8211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000048b2a4d9/0x64919c0f856c0d0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5553 expref: 7 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.002500:0:8211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0400, rc 0) 00000100:00100000:2.0:1789545729.002556:0:8211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a8edb7a-f384-4468-93f4-9d664f284862+7:10538:x1876474438138880:12345-192.168.201.16@tcp:101:bash.0 Request processed in 8276us (8501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545729.002564:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 35 00000100:00100000:0.0:1789545729.004848:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bffcdad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5832:1876474454935808:192.168.201.16@tcp:105: 00010000:00010000:0.0:1789545729.004875:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789545729.004938:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd9364c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a8edb7a-f384-4468-93f4-9d664f284862+6:2358:x1876474438139008:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3236us (3441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545729.004949:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 49 00000100:00100000:0.0:1789545729.005858:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545729.005928:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438139264 00000100:00100000:1.0:1789545729.005936:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438139264 00000100:00100000:1.0:1789545729.005981:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 25 00000100:00100000:1.0:1789545729.005990:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bffcdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+33:10538:x1876474438139264:12345-192.168.201.16@tcp:35:bash.0 00000100:00100000:1.0:1789545729.008403:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bffcdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+34:10538:x1876474438139264:12345-192.168.201.16@tcp:35:bash.0 Request processed in 2402us (2536us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1789545729.008416:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 25 00000100:00100000:1.0:1789545729.084745:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789545729.084771:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454935936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789545729.084845:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545729.085128:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4940e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454936064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789545729.085178:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545729.085837:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454935936 00000100:00100000:3.0:1789545729.085847:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454935936 00000100:00100000:3.0:1789545729.085887:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454936064 00000100:00100000:3.0:1789545729.085890:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454936064 00000100:00100000:3.0:1789545729.085906:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789545729.085916:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876474454935936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789545729.085954:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789545729.086030:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876474454935936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545729.086037:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789545729.086055:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789545729.086062:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bffcda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454936064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789545729.086082:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789545729.086116:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bffcda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454936064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545729.086122:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789545729.086938:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1789545729.086957:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1789545729.086979:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff994be4ed6d80, transno 4294967301 00000100:00100000:0.0:1789545729.087006:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4940e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454936064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789545729.087045:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454935936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789545729.157172:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545729.157348:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438139392 00000100:00100000:3.0:1789545729.157399:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438139392 00000100:00100000:3.0:1789545729.157453:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 97 00000100:00100000:3.0:1789545729.157465:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+34:10554:x1876474438139392:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:3.0:1789545729.157507:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545729.157527:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0d15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de555a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.157597:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0d1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.157614:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0d1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.157628:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0d1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545729.157665:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789545729.157669:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789545729.157686:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0d1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.157710:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0d15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de555a expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.157730:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0d1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de555a expref: 35 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.157740:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:3.0:1789545729.157743:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789545729.157747:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217fa00, rc 0) 00000100:00100000:3.0:1789545729.157821:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+35:10554:x1876474438139392:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 357us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545729.157827:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 97 00000100:00100000:3.0:1789545729.167681:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545729.168219:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438139648 00000100:00100000:0.0:1789545729.168232:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438139648 00000100:00100000:0.0:1789545729.168302:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 98 00000100:00100000:0.0:1789545729.168314:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+35:10554:x1876474438139648:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:0.0:1789545729.168349:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545729.168405:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0d23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5561 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.168511:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0d2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.168526:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0d2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.168537:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0d2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789545729.168549:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789545729.168673:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0d23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5561 expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.168688:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0d2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5561 expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.168713:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f9ec00) 00010000:00010000:0.0:1789545729.168716:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789545729.168719:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb6400, rc 0) 00000100:00100000:0.0:1789545729.168789:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+37:10554:x1876474438139648:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 478us (1118us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1789545729.168795:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 98 00000100:00100000:1.0:1789545729.175006:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545729.175149:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438139904 00000100:00100000:3.0:1789545729.175161:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438139904 00000100:00100000:3.0:1789545729.175268:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 99 00000100:00100000:3.0:1789545729.175279:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+37:10554:x1876474438139904:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:3.0:1789545729.175304:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545729.175336:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0d38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5568 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.177642:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0d3f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.177666:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0d3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.177677:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0d3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545729.177689:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789545729.177817:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0d38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5568 expref: 40 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.177841:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0d3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5568 expref: 39 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.177851:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f9ec00) 00010000:00010000:3.0:1789545729.177854:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789545729.177857:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217fe00, rc 0) 00000100:00100000:3.0:1789545729.178048:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+39:10554:x1876474438139904:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 2769us (3050us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1789545729.178069:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 99 00000100:00100000:2.0:1789545729.182497:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545729.182670:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438140032 00000100:00100000:2.0:1789545729.182680:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438140032 00000100:00100000:2.0:1789545729.182741:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 6 00000100:00100000:2.0:1789545729.182752:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+39:2359:x1876474438140032:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789545729.182765:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545729.182790:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0d2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5561 expref: 39 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.182811:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f9ec00) 00010000:00010000:2.0:1789545729.182817:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789545729.182877:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+38:2359:x1876474438140032:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 127us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545729.182885:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 6 00000100:00100000:2.0:1789545729.187588:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545729.187665:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438140160 00000100:00100000:3.0:1789545729.187675:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438140160 00000100:00100000:3.0:1789545729.187736:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 36 00000100:00100000:3.0:1789545729.187747:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+6:2359:x1876474438140160:12345-192.168.201.16@tcp:1:lfs.0 00010000:00010000:3.0:1789545729.187795:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002817eb8a/0x64919c0f856c0d4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.187818:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000048b2a4d9/0x64919c0f856c0d0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5553 expref: 6 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.187827:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789545729.187832:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789545729.187838:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002817eb8a/0x64919c0f856c0d4d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.187874:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000048b2a4d9/0x64919c0f856c0d0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5553 expref: 6 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.187889:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000048b2a4d9/0x64919c0f856c0d0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5553 expref: 6 pid: 8211 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545729.187917:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4942d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876474454936192:192.168.201.16@tcp:104: 00000100:00100000:3.0:1789545729.188059:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfae0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789545729.192099:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545729.192203:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4942d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876474454936192:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545729.192263:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002817eb8a/0x64919c0f856c0d4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545729.192428:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438140288 00000100:00100000:0.0:1789545729.192436:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438140288 00002000:00100000:0.0:1789545729.192485:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff994beddf1f80 x1876474438140288/t0(0) o4->8a8edb7a-f384-4468-93f4-9d664f284862@192.168.201.16@tcp:195/0 lens 504/0 e 0 to 0 dl 1789545740 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789545729.192495:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994beddf1f80 with x1876474438140288 ext(0->8) 00010000:00010000:0.0:1789545729.192502:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000048b2a4d9/0x64919c0f856c0d0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5553 expref: 7 pid: 8211 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.192517:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000048b2a4d9/0x64919c0f856c0d0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5553 expref: 7 pid: 8211 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789545729.192524:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff994beddf1f80 00000100:00100000:0.0:1789545729.192559:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1 00000100:00100000:0.0:1789545729.192570:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8a8edb7a-f384-4468-93f4-9d664f284862+7:2358:x1876474438140288:12345-192.168.201.16@tcp:4:lfs.0 00000100:00100000:0.0:1789545729.193051:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8a8edb7a-f384-4468-93f4-9d664f284862+9:2358:x1876474438140288:12345-192.168.201.16@tcp:4:lfs.0 Request processed in 481us (960us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789545729.193060:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1 00002000:00100000:0.0:1789545729.193067:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff994beddf1f80 x1876474438140288/t4294967302(0) o4->8a8edb7a-f384-4468-93f4-9d664f284862@192.168.201.16@tcp:195/0 lens 504/448 e 0 to 0 dl 1789545740 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789545729.193081:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994beddf1f80 with x1876474438140288 ext(0->8) 00010000:00010000:0.0:1789545729.193088:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000048b2a4d9/0x64919c0f856c0d0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5553 expref: 9 pid: 8211 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.193100:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000048b2a4d9/0x64919c0f856c0d0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5553 expref: 9 pid: 8211 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789545729.193108:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff994beddf1f80 00000100:00100000:2.0:1789545729.198334:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545729.198673:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438140416 00000100:00100000:0.0:1789545729.198683:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438140416 00010000:00010000:0.0:1789545729.198726:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000048b2a4d9/0x64919c0f856c0d0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5553 expref: 9 pid: 8211 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545729.198770:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 50 00000100:00100000:0.0:1789545729.198780:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a8edb7a-f384-4468-93f4-9d664f284862+9:2359:x1876474438140416:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789545729.198795:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789545729.198813:0:7636:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789545729.198816:0:7636:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789545729 00002000:00010000:0.0:1789545729.198819:0:7636:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789545729 00002000:00010000:0.0:1789545729.198821:0:7636:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789545729 00010000:00010000:0.0:1789545729.198827:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000048b2a4d9/0x64919c0f856c0d0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5553 expref: 9 pid: 8211 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.198842:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000048b2a4d9/0x64919c0f856c0d0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5553 expref: 9 pid: 8211 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.198885:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048b2a4d9/0x64919c0f856c0d0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5553 expref: 9 pid: 8211 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.198913:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789545729.198918:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789545729.198924:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002817eb8a/0x64919c0f856c0d4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.198934:0:7636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002817eb8a/0x64919c0f856c0d4d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.198967:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789545729.199027:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a8edb7a-f384-4468-93f4-9d664f284862+8:2359:x1876474438140416:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 248us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545729.199036:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 50 00010000:00010000:3.0:1789545729.199244:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002817eb8a/0x64919c0f856c0d4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.199255:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002817eb8a/0x64919c0f856c0d4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.199278:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002817eb8a/0x64919c0f856c0d4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.199287:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002817eb8a/0x64919c0f856c0d4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.199295:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002817eb8a/0x64919c0f856c0d4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.199301:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217f400 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545729.199306:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002817eb8a/0x64919c0f856c0d4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.199330:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002817eb8a/0x64919c0f856c0d4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.199344:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002817eb8a/0x64919c0f856c0d4d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.199394:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002817eb8a/0x64919c0f856c0d4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545729.199450:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+7:2359:x1876474438140160:12345-192.168.201.16@tcp:1:lfs.0 Request processed in 11705us (11871us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545729.199459:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 36 00000100:00100000:2.0:1789545729.205423:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545729.205506:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438140672 00000100:00100000:0.0:1789545729.205517:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438140672 00000100:00100000:0.0:1789545729.205575:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 26 00000100:00100000:0.0:1789545729.205587:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8cc5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+38:10554:x1876474438140672:12345-192.168.201.16@tcp:35:lfs.0 00000004:00010000:0.0:1789545729.205655:0:5850:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0d3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5568 expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789545729.205914:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1789545729.205961:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1789545729.206270:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1789545729.206339:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0d54 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.206404:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0cf9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5545 expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.206415:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0d54 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.206452:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0cf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5545 expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.206466:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0cf9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5545 expref: 42 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545729.206480:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bffcda300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5850:1876474454936320:192.168.201.16@tcp:104: 00000100:00100000:0.0:1789545729.206559:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff994becff10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789545729.209033:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545729.209131:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438140800 00000100:00100000:1.0:1789545729.209155:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438140800 00010000:00010000:1.0:1789545729.209196:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0cf9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5545 expref: 43 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545729.209239:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 51 00000100:00100000:1.0:1789545729.209249:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a8edb7a-f384-4468-93f4-9d664f284862+43:2358:x1876474438140800:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789545729.209264:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545729.209273:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0cf9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5545 expref: 43 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545729.209288:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0cf9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5545 expref: 43 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545729.209310:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f9ec00) 00010000:00010000:1.0:1789545729.209325:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0d54 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545729.209336:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0d54 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545729.209344:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0d54 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545729.209393:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789545729.209445:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a8edb7a-f384-4468-93f4-9d664f284862+43:2358:x1876474438140800:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 197us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545729.209454:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 51 00010000:00010000:0.0:1789545729.209864:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0cf9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5545 expref: 42 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545729.209884:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bffcda300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5850:1876474454936320:192.168.201.16@tcp:104: 00010000:00010000:0.0:1789545729.209905:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0d54 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.209915:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0d54 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.209921:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0d54 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789545729.210044:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1789545729.210255:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1789545729.212931:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994beddf0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1876474454936448:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789545729.213006:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545729.213065:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff994be75f0240 going to sleep for 11 seconds 00000100:00100000:0.0:1789545729.213544:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454936448 00000100:00100000:0.0:1789545729.213553:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454936448 00000100:00100000:0.0:1789545729.213611:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789545729.213621:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1876474454936448:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789545729.213726:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1876474454936448:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 107us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545729.213734:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789545729.214050:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994beddf0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1876474454936448:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789545729.214635:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1789545729.214715:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4942d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1876474454936576:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789545729.214760:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545729.214793:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfae0840 going to sleep for 11 seconds 00000100:00100000:0.0:1789545729.215246:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454936576 00000100:00100000:0.0:1789545729.215253:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454936576 00000100:00100000:0.0:1789545729.215293:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789545729.215302:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1876474454936576:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789545729.215528:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1876474454936576:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 226us (766us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789545729.215536:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789545729.216250:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4942d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1876474454936576:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789545729.216332:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1789545729.216411:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0d54 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.216424:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0d54 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.216431:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0d54 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.216437:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545729.216442:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0d54 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.216466:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0d54 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.216482:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f9ec00) 00010000:00010000:3.0:1789545729.216485:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789545729.216491:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0d54 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.216498:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0d54 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789545729.216696:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789545729.216790:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1789545729.216801:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 343139440967ns, next at 344139438996ns, rc = 0 00000001:00080000:3.0:1789545729.216807:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1789545729.216839:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f9ec00) 00010000:00010000:3.0:1789545729.216842:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789545729.216850:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0d3f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5568 expref: 46 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545729.216964:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8cc5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+45:10554:x1876474438140672:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 11378us (11549us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1789545729.216973:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 26 00000020:00080000:3.0:1789545729.216977:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789545729.221734:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545729.221798:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438140928 00000100:00100000:0.0:1789545729.221808:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438140928 00000100:00100000:0.0:1789545729.221862:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 100 00000100:00100000:0.0:1789545729.221872:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf4ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+45:10554:x1876474438140928:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:0.0:1789545729.221896:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545729.221916:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0d5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de556f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.221974:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0d5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de556f expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.221989:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0d5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de556f expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.222030:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:0.0:1789545729.222034:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789545729.222038:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb7800, rc 0) 00000100:00100000:0.0:1789545729.222104:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf4ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+46:10554:x1876474438140928:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 232us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545729.222112:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 100 00000100:00100000:1.0:1789545729.225242:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545729.225513:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438141184 00000100:00100000:2.0:1789545729.225524:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438141184 00000100:00100000:2.0:1789545729.225593:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 27 00000100:00100000:2.0:1789545729.225605:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+46:10554:x1876474438141184:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:2.0:1789545729.225844:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+47:10554:x1876474438141184:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 241us (622us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1789545729.225867:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 27 00000100:00100000:3.0:1789545729.335470:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545729.335618:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438141312 00000100:00100000:0.0:1789545729.335629:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438141312 00000100:00100000:0.0:1789545729.335685:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 101 00000100:00100000:0.0:1789545729.335693:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+47:10564:x1876474438141312:12345-192.168.201.16@tcp:34:lfs.0 00010000:00010000:0.0:1789545729.335766:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0d62 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.335784:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0d62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.335796:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0d62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.335810:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0d69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.335817:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0d69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.335823:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0d69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.335918:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0d70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.335938:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0d70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.335946:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0d70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789545729.335990:0:10125:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0d70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.336002:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0d62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.336020:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0d62 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.336028:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0d62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.336034:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb7200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545729.336038:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0d62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.336045:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0d62 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.336057:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:0.0:1789545729.336060:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545729.336065:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0d62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.336071:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0d62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.336091:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0d69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.336097:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0d69 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.336103:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0d69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.336109:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb7400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545729.336111:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0d69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.336117:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0d69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.336125:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff994bc4f11000) 00010000:00010000:0.0:1789545729.336127:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545729.336130:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0d69 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.336135:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0d69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.336149:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0d70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.336155:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0d70 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.336160:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0d70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.336172:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6800 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545729.336175:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0d70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.336181:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0d70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.336188:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:0.0:1789545729.336190:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545729.336192:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0d70 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.336197:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0d70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545729.336609:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+47:10564:x1876474438141312:12345-192.168.201.16@tcp:34:lfs.0 Request processed in 913us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545729.336618:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 101 00000100:00100000:1.0:1789545729.379086:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545729.379206:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438141568 00000100:00100000:0.0:1789545729.379230:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438141568 00000100:00100000:0.0:1789545729.379307:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 102 00000100:00100000:0.0:1789545729.379329:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+47:10567:x1876474438141568:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:0.0:1789545729.379355:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545729.379418:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0d77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5576 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.379519:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0d7e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.379558:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0d7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.379571:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0d7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.379588:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0d85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.379595:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.379602:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.379748:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c0d8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.379755:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c0d8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.379762:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c0d8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789545729.379772:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789545729.379892:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0d7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.379901:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0d7e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.379908:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0d7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.379921:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb7400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545729.379926:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0d7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.379934:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0d7e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.379948:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:0.0:1789545729.379951:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545729.379957:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0d7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.379964:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0d7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.379978:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.379984:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0d85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.379990:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0d85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.379996:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb7200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545729.379999:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0d85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.380004:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0d85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.380019:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff994bc4f11000) 00010000:00010000:0.0:1789545729.380022:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545729.380025:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0d85 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.380030:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0d85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.380073:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0d77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5576 expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.380086:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c0d8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5576 expref: 49 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.380092:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:0.0:1789545729.380094:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789545729.380097:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb6200, rc 0) 00000100:00100000:0.0:1789545729.380178:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+49:10567:x1876474438141568:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 852us (1105us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1789545729.380186:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 102 00000100:00100000:1.0:1789545729.384748:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545729.384819:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438141696 00000100:00100000:0.0:1789545729.384831:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438141696 00000100:00100000:0.0:1789545729.384900:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 103 00000100:00100000:0.0:1789545729.384912:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+49:10567:x1876474438141696:12345-192.168.201.16@tcp:54:lfs.0 00010000:00010000:0.0:1789545729.385016:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0d9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.385034:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0d9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.385062:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0d9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.385095:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0d9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.385100:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0d9a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.385105:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0d9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.385109:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6800 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545729.385114:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0d9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.385122:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0d9a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.385134:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:0.0:1789545729.385137:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789545729.385144:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0d9a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.385151:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0d9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545729.385236:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+49:10567:x1876474438141696:12345-192.168.201.16@tcp:54:lfs.0 Request processed in 326us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545729.385246:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 103 00000100:00100000:3.0:1789545729.389862:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545729.389924:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438141952 00000100:00100000:2.0:1789545729.389940:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438141952 00000100:00100000:2.0:1789545729.390025:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 28 00000100:00100000:2.0:1789545729.390038:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+49:10567:x1876474438141952:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:2.0:1789545729.390618:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+50:10567:x1876474438141952:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 579us (765us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1789545729.390627:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 28 00000100:00100000:1.0:1789545729.443833:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545729.443966:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438142208 00000100:00100000:0.0:1789545729.443980:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438142208 00000100:00100000:0.0:1789545729.444099:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 104 00000100:00100000:0.0:1789545729.444109:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+50:10577:x1876474438142208:12345-192.168.201.16@tcp:101:bash.0 00010000:00010000:0.0:1789545729.444143:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545729.444148:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789545729.444184:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0d1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de555a expref: 50 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.444212:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:0.0:1789545729.444218:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789545729.444236:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0da1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de557d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.444434:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0da8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.444450:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c0d8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5576 expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.444460:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0da8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.444522:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c0d8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5576 expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.444537:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c0d8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5576 expref: 50 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545729.444575:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bffcda300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876474454936704:192.168.201.16@tcp:104: 00000100:00100000:0.0:1789545729.444704:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff994becff10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789545729.447212:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545729.447234:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bffcda300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876474454936704:192.168.201.16@tcp:104: 00010000:00010000:0.0:1789545729.447272:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0da8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545729.447400:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438142336 00000100:00100000:2.0:1789545729.447408:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438142336 00010000:00010000:2.0:1789545729.447452:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c0d8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5576 expref: 51 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545729.447482:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 52 00000100:00100000:2.0:1789545729.447858:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+51:2359:x1876474438142336:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789545729.447880:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545729.447888:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c0d8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5576 expref: 51 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.447902:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c0d8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5576 expref: 51 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.447931:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c0d8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5576 expref: 51 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.447948:0:7637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:2.0:1789545729.447970:0:7637:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0da8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.447980:0:7637:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0da8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.447989:0:7637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0da8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.448108:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789545729.448185:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+50:2359:x1876474438142336:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 693us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545729.448194:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 52 00010000:00010000:0.0:1789545729.448252:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0da8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.448260:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0da8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789545729.448287:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789545729.448772:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0da1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de557d expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.448792:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0da8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de557d expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.448800:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:0.0:1789545729.448803:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789545729.448806:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb7200, rc 0) 00000100:00100000:0.0:1789545729.448857:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+50:10577:x1876474438142208:12345-192.168.201.16@tcp:101:bash.0 Request processed in 4749us (5036us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1789545729.448865:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 104 00000100:00100000:1.0:1789545729.450730:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545729.450819:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438142592 00000100:00100000:3.0:1789545729.450830:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438142592 00000100:00100000:3.0:1789545729.450904:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 105 00000100:00100000:3.0:1789545729.450926:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+50:10577:x1876474438142592:12345-192.168.201.16@tcp:36:bash.0 00010000:00010000:3.0:1789545729.451265:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0db6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.451287:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0db6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.451317:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0db6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789545729.451632:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1789545729.451656:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cace018a reply state 00000000c4ec2356 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0db6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545729.451665:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789545729.451798:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+53:10577:x1876474438142592:12345-192.168.201.16@tcp:36:bash.0 Request processed in 876us (1076us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1789545729.451805:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 105 00000020:00080000:3.0:1789545729.451810:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789545729.454457:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545729.454513:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438142720 00000100:00100000:3.0:1789545729.454528:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438142720 00000100:00100000:3.0:1789545729.454603:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 106 00000100:00100000:3.0:1789545729.454616:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+53:10577:x1876474438142720:12345-192.168.201.16@tcp:101:bash.0 00010000:00010000:3.0:1789545729.454648:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545729.454674:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0dbd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5584 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.454686:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0db6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.454695:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0db6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.454702:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0db6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.454708:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217fe00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545729.454713:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0db6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.454721:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0db6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.454740:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:2.0:1789545729.454743:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545729.454750:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0db6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.454774:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0db6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.454779:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0dc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.454799:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0da8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de557d expref: 53 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.454810:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0dc4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.454851:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0da8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de557d expref: 53 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.454863:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0da8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de557d expref: 53 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545729.454876:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4942300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1876474454936832:192.168.201.16@tcp:104: 00000100:00100000:3.0:1789545729.454973:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfae0840 going to sleep for 11 seconds 00000100:00100000:3.0:1789545729.460056:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4942300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1876474454936832:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545729.460108:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0dc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545729.461198:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545729.461810:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545729.461857:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545729.461936:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438143104 00000100:00100000:0.0:1789545729.461971:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438143104 00000100:00100000:0.0:1789545729.462062:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 75 00000100:00100000:0.0:1789545729.462075:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+8:2359:x1876474438143104:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:3.0:1789545729.462076:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438142976 00000100:00100000:3.0:1789545729.462081:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438142976 00000100:00100000:3.0:1789545729.462129:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 288 00000100:00100000:3.0:1789545729.462137:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2358:x1876474438142976:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:0.0:1789545729.462218:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+8:2359:x1876474438143104:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 95us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545729.462228:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 75 00000100:00100000:2.0:1789545729.462394:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438142848 00000100:00100000:2.0:1789545729.462400:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438142848 00010000:00010000:2.0:1789545729.462434:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0da8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de557d expref: 54 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545729.462465:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 53 00000100:00100000:2.0:1789545729.462474:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be479b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a8edb7a-f384-4468-93f4-9d664f284862+54:2358:x1876474438142848:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789545729.462487:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545729.462495:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0da8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de557d expref: 54 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.462508:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0da8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de557d expref: 54 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.462534:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c0da8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de557d expref: 54 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.462554:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:2.0:1789545729.462560:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0dc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.462570:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.462579:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0dc4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.462619:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545729.462714:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2358:x1876474438142976:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 576us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545729.462722:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 288 00000100:00100000:1.0:1789545729.462765:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:3.0:1789545729.462768:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.462782:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545729.462844:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789545729.462850:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789545729.462875:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545729.462901:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438143232 00000100:00100000:1.0:1789545729.462905:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438143232 00010000:00010000:3.0:1789545729.462920:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0dbd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5584 expref: 54 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789545729.462930:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789545729.462940:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0dc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5584 expref: 53 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.462947:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:3.0:1789545729.462950:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789545729.462953:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217fc00, rc 0) 00000100:00100000:1.0:1789545729.462958:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 135 00000100:00100000:1.0:1789545729.462966:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be479a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2358:x1876474438143232:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:3.0:1789545729.462982:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+53:10577:x1876474438142720:12345-192.168.201.16@tcp:101:bash.0 Request processed in 8370us (8700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545729.462988:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 106 00000100:00100000:1.0:1789545729.463010:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be479a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2358:x1876474438143232:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 45us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545729.463017:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 135 00000100:00100000:2.0:1789545729.463838:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be479b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a8edb7a-f384-4468-93f4-9d664f284862+52:2358:x1876474438142848:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1358us (2642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545729.463850:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 53 00000100:00100000:0.0:1789545729.466147:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545729.466205:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438143488 00000100:00100000:3.0:1789545729.466217:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438143488 00000100:00100000:3.0:1789545729.466284:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 29 00000100:00100000:3.0:1789545729.466296:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bffcda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+52:10577:x1876474438143488:12345-192.168.201.16@tcp:35:bash.0 00000100:00100000:3.0:1789545729.466750:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bffcda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+53:10577:x1876474438143488:12345-192.168.201.16@tcp:35:bash.0 Request processed in 455us (615us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1789545729.466758:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 29 00000100:00100000:0.0:1789545729.519067:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545729.519663:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438143616 00000100:00100000:3.0:1789545729.519679:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438143616 00000100:00100000:2.0:1789545729.519911:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 107 00000100:00100000:2.0:1789545729.519925:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bffcdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+53:10583:x1876474438143616:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:2.0:1789545729.519959:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545729.519985:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0dcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de558b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.520076:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0dd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.520095:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.520108:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545729.520393:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789545729.520398:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789545729.520425:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.520458:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0dcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de558b expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.520481:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de558b expref: 54 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.520614:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:2.0:1789545729.520617:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789545729.520623:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0a00, rc 0) 00000100:00100000:2.0:1789545729.520778:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bffcdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+54:10583:x1876474438143616:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 854us (1724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545729.520786:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 107 00000100:00100000:1.0:1789545729.537870:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545729.537978:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438143744 00000100:00100000:3.0:1789545729.537992:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438143744 00000100:00100000:3.0:1789545729.538091:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 108 00000100:00100000:3.0:1789545729.538101:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+54:10583:x1876474438143744:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:3.0:1789545729.538127:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545729.538154:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0dd9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5592 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.538252:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0de0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.538271:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0de0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.538285:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0de0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.538631:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0de7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.538640:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0de7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.538646:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0de7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.538745:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0dee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.538751:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0dee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.538772:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0dee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545729.538813:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789545729.538818:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789545729.538834:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0dee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.538846:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0dee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.538852:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0de0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.538858:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0de0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.538863:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0de0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.538867:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217f000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545729.538870:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0de0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.538877:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0de0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.538887:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:3.0:1789545729.538889:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545729.538894:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0de0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.538914:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0de0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.538933:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0de7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.538939:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0de7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.538944:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0de7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.538950:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217fe00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545729.538953:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0de7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.538960:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0de7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.538967:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff994bc4f9ea00) 00010000:00010000:3.0:1789545729.538969:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545729.538971:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0de7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.538976:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0de7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.539006:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0dd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5592 expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.539016:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0dee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5592 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.539026:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:3.0:1789545729.539027:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789545729.539029:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217fa00, rc 0) 00000100:00100000:3.0:1789545729.539107:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+55:10583:x1876474438143744:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 1007us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545729.539117:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 108 00000100:00100000:1.0:1789545729.543036:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545729.543145:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438144000 00000100:00100000:3.0:1789545729.543160:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438144000 00000100:00100000:2.0:1789545729.543980:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 109 00000100:00100000:2.0:1789545729.543998:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+55:10583:x1876474438144000:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:2.0:1789545729.544029:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1789545729.544038:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:2.0:1789545729.544055:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0df5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5599 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.544190:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0dfc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.544205:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0dc4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5584 expref: 56 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.544219:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0dee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5592 expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.544237:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0dfc lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545729.544409:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438144128 00000100:00100000:0.0:1789545729.544418:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438144128 00010000:00010000:0.0:1789545729.544455:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0dee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5592 expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545729.544505:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 54 00000100:00100000:0.0:1789545729.544514:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+57:2358:x1876474438144128:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789545729.544526:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789545729.545172:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:0.0:1789545729.545177:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0dfc lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.545185:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0dfc lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.545189:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789545729.545476:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c0dee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5592 expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.545670:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0dc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5584 expref: 56 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.545683:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0dc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5584 expref: 56 pid: 5848 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545729.545696:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf4ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876474454937088:192.168.201.16@tcp:104: 00000100:00100000:0.0:1789545729.545753:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+56:2358:x1876474438144128:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1241us (1714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545729.545762:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 54 00000100:00100000:2.0:1789545729.545868:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff994c020c6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789545729.549002:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545729.549067:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438144256 00000100:00100000:3.0:1789545729.549081:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438144256 00000100:00100000:2.0:1789545729.549113:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf4ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876474454937088:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545729.549134:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0dc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5584 expref: 56 pid: 5848 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545729.549186:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 55 00000100:00100000:3.0:1789545729.549197:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd9367450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+56:2359:x1876474438144256:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789545729.549215:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0dfc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.549225:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545729.549234:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0dc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5584 expref: 56 pid: 5848 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.549247:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0dc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5584 expref: 56 pid: 5848 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.549275:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0dc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5584 expref: 56 pid: 5848 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.549307:0:7637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:3.0:1789545729.549332:0:7637:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0dfc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.549343:0:7637:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0dfc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.549352:0:7637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0dfc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.549768:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789545729.549831:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd9367450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+55:2359:x1876474438144256:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 633us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545729.549841:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 55 00010000:00010000:2.0:1789545729.550866:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0dfc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.550880:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0dfc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545729.550960:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789545729.551477:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0df5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5599 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.551719:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0dfc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5599 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.551726:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:2.0:1789545729.551745:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789545729.551748:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0200, rc 0) 00000100:00100000:2.0:1789545729.551818:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+55:10583:x1876474438144000:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 7825us (8794us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1789545729.551827:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 109 00000100:00100000:0.0:1789545729.555607:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545729.555731:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438144512 00000100:00100000:2.0:1789545729.555746:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438144512 00000100:00100000:2.0:1789545729.555839:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7 00000100:00100000:2.0:1789545729.555853:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bffcdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a8edb7a-f384-4468-93f4-9d664f284862+55:10583:x1876474438144512:12345-192.168.201.16@tcp:103:lfs.0 00010000:00010000:2.0:1789545729.555874:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545729.555917:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c0d5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de556f expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545729.555941:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:2.0:1789545729.555947:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789545729.556182:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bffcdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a8edb7a-f384-4468-93f4-9d664f284862+54:10583:x1876474438144512:12345-192.168.201.16@tcp:103:lfs.0 Request processed in 330us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545729.556191:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7 00000100:00100000:1.0:1789545729.568116:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545729.568471:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438144640 00000100:00100000:0.0:1789545729.568665:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438144640 00000100:00100000:0.0:1789545729.568795:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 110 00000100:00100000:0.0:1789545729.568809:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+54:10583:x1876474438144640:12345-192.168.201.16@tcp:58:lfs.0 00010000:00010000:0.0:1789545729.568999:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0e0a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.569021:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0e0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545729.569035:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0e0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789545729.569357:0:10125:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1789545729.569864:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+54:10583:x1876474438144640:12345-192.168.201.16@tcp:58:lfs.0 Request processed in 1053us (1758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545729.569877:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 110 00000100:00100000:0.0:1789545729.573454:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545729.573657:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438144768 00000100:00100000:3.0:1789545729.573674:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438144768 00000100:00100000:3.0:1789545729.573800:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 111 00000100:00100000:3.0:1789545729.573812:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bffcdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+54:10583:x1876474438144768:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:3.0:1789545729.573841:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545729.573867:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0e11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de55a0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.573957:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0e0a lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.573970:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0e11 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55a0 expref: 55 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.573995:0:5848:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0e0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.574009:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0e11 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55a0 expref: 55 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.574025:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:3.0:1789545729.574049:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789545729.574054:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0e11 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55a0 expref: 55 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545729.574063:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217fc00, rc 0) 00000100:00100000:3.0:1789545729.574183:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bffcdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+55:10583:x1876474438144768:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 372us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545729.574191:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 111 00010000:00010000:2.0:1789545729.852733:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789545730.556693:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789545730.556704:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789545730.556772:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1789545730.556781:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789545730.556906:0:11700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4942300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1876474454937216:192.168.201.16@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789545730.557142:0:11700:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfae0600 going to sleep for 11 seconds 00000100:00100000:0.0:1789545730.566004:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545730.566429:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438144896 00000100:00100000:1.0:1789545730.566443:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438144896 00000100:00100000:1.0:1789545730.566540:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 112 00000100:00100000:1.0:1789545730.566557:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bffcd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+56:10584:x1876474438144896:12345-192.168.201.16@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789545730.566624:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789545730.566776:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bffcd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+56:10584:x1876474438144896:12345-192.168.201.16@tcp:53:lhsmtool_posix.0 Request processed in 225us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545730.566786:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 112 00000100:00080000:0.0:1789545730.567107:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789545730.567218:0:11700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4942300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1876474454937216:192.168.201.16@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789545730.573638:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545730.574778:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438145024 00000100:00100000:2.0:1789545730.574795:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438145024 00000100:00100000:3.0:1789545730.574995:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 113 00000100:00100000:3.0:1789545730.575012:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+55:10584:x1876474438145024:12345-192.168.201.16@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789545730.575125:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0e18 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.575147:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0e18 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.575165:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0e18 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.580117:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0e1f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.580163:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0e1f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.580178:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0e1f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.580212:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0e26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.580222:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0e26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.580228:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0e26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545730.580277:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789545730.580282:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789545730.582056:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0e26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.582080:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0e18 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.582088:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0e18 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.582095:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0e18 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.582101:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217f400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545730.582104:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0e18 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.582127:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0e18 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.582141:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff994bc4f11700) 00010000:00010000:3.0:1789545730.582144:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545730.582148:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0e18 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.582155:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0e18 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.582265:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0e1f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.582272:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0e1f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.582278:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0e1f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.582283:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217fe00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545730.582285:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0e1f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.582301:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0e1f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.582309:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff994bc4f9ea00) 00010000:00010000:3.0:1789545730.582311:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545730.582314:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0e1f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.582332:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0e1f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.582349:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0e26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.582355:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0e26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.582437:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0e26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.582442:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217f000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545730.582445:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0e26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.582451:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0e26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.582460:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:3.0:1789545730.582462:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545730.582465:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0e26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.582471:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0e26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545730.582789:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+55:10584:x1876474438145024:12345-192.168.201.16@tcp:34:lhsmtool_posix.0 Request processed in 7776us (9159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545730.582799:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 113 00000100:00100000:1.0:1789545730.597405:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545730.598248:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438145280 00000100:00100000:3.0:1789545730.598267:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438145280 00000100:00100000:3.0:1789545730.598397:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 114 00000100:00100000:3.0:1789545730.598411:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+55:10584:x1876474438145280:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789545730.598441:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545730.598465:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0e2d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de55a7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.598612:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0e34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.598633:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0e34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.598646:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0e34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545730.598659:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789545730.598799:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0e34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.598808:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0e34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.598815:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0e34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.598822:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217fe00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545730.598828:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0e34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.598836:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0e34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.598869:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:3.0:1789545730.598884:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789545730.598891:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0e34 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.598899:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0e34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.598955:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0e2d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55a7 expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.598967:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff994bc4f11700) 00010000:00010000:3.0:1789545730.598970:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789545730.598974:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0e2d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55a7 expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.598985:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217f000, rc 0) 00000100:00100000:3.0:1789545730.599082:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+56:10584:x1876474438145280:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 673us (1692us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1789545730.599090:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 114 00000100:00100000:0.0:1789545730.604913:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545730.605046:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438145408 00000100:00100000:2.0:1789545730.605061:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438145408 00000100:00100000:2.0:1789545730.605146:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 115 00000100:00100000:2.0:1789545730.605159:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bffcd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+56:10584:x1876474438145408:12345-192.168.201.16@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789545730.605239:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789545730.605435:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bffcd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+56:10584:x1876474438145408:12345-192.168.201.16@tcp:53:lhsmtool_posix.0 Request processed in 277us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545730.605453:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 115 00000100:00100000:1.0:1789545730.615138:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545730.617191:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438145664 00000100:00100000:2.0:1789545730.617213:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438145664 00000100:00100000:2.0:1789545730.617318:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 116 00000100:00100000:2.0:1789545730.617331:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+56:10584:x1876474438145664:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789545730.617386:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545730.617390:0:10125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789545730.617426:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0dd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de558b expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.617458:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:2.0:1789545730.617466:0:10125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789545730.617486:0:10125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0e42 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de55ae expref: -99 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789545730.618576:0:10125:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1789545730.618832:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0e49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.618850:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0e49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.618863:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0e49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.618944:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0e42 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55ae expref: 58 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.618988:0:10125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0e49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55ae expref: 57 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.618998:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff994bcd248c00) 00010000:00010000:2.0:1789545730.619001:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789545730.619005:0:10125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0c00, rc 0) 00000100:00100000:2.0:1789545730.620067:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+57:10584:x1876474438145664:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 2733us (4938us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1789545730.620859:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 116 00000100:00100000:1.0:1789545730.629806:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545730.630740:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438145920 00000100:00100000:2.0:1789545730.630755:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438145920 00000100:00100000:2.0:1789545730.631025:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 117 00000100:00100000:2.0:1789545730.631041:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+57:10584:x1876474438145920:12345-192.168.201.16@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789545730.631127:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545730.631164:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0e49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55ae expref: 57 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.631189:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff994bcd248c00) 00010000:00010000:2.0:1789545730.631204:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789545730.631236:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0e57 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.631254:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0e57 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.631266:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0e57 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.637321:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0e5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x61766f6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.637347:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0e5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x61766f6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.637376:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0e5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x61766f6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.637583:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0e57 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.637593:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0e57 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.637600:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0e57 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.637607:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0a00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545730.637612:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0e57 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.637621:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0e57 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.637633:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:2.0:1789545730.637637:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545730.637643:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0e57 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.637650:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c0e57 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.637679:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0e5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x61766f6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.637685:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0e5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x61766f6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.637692:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0e5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x61766f6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.637698:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545730.637701:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0e5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x61766f6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.637707:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0e5e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x61766f6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.637715:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x61766f6c (ffff994bcd248700) 00010000:00010000:2.0:1789545730.637718:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545730.637721:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0e5e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x61766f6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.637727:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0e5e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x61766f6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545730.637835:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+56:10584:x1876474438145920:12345-192.168.201.16@tcp:36:lhsmtool_posix.0 Request processed in 6793us (8039us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789545730.637845:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 117 00000100:00100000:0.0:1789545730.644638:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545730.644813:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438146048 00000100:00100000:3.0:1789545730.644828:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438146048 00000100:00100000:3.0:1789545730.644915:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 118 00000100:00100000:3.0:1789545730.644928:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bffcd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+56:10584:x1876474438146048:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789545730.644958:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545730.644988:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0e65 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de55b5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.645063:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0e6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.645078:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0e6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.645093:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0e6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.645217:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0e65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55b5 expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.645243:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0e6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55b5 expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.645252:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff994bc4f9ea00) 00010000:00010000:3.0:1789545730.645256:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789545730.645260:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217fe00, rc 0) 00000100:00100000:3.0:1789545730.645395:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bffcd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+57:10584:x1876474438146048:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 469us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545730.645402:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 118 00000100:00100000:0.0:1789545730.651796:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545730.652047:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438146304 00000100:00100000:3.0:1789545730.652062:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438146304 00000100:00100000:3.0:1789545730.652136:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 119 00000100:00100000:3.0:1789545730.652148:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bffcdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+57:10584:x1876474438146304:12345-192.168.201.16@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789545730.652264:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0e73 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.652446:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0e73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.652460:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0e73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789545730.653001:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1789545730.653014:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 344575653892ns, next at 345575650865ns, rc = 0 00000004:00010000:3.0:1789545730.653133:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9bc6afa reply state 00000000673e1a3e transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0e73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545730.653145:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789545730.653496:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bffcdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+59:10584:x1876474438146304:12345-192.168.201.16@tcp:36:lhsmtool_posix.0 Request processed in 1346us (1711us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1789545730.653517:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 119 00000100:00100000:1.0:1789545730.660268:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:3.0:1789545730.660399:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0e73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.660415:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0e73 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.660424:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0e73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.660432:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217f400 already unused, calling callback (ffffffffc212d4f0) 00000100:00100000:2.0:1789545730.660437:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438146432 00010000:00010000:3.0:1789545730.660440:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0e73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.660454:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0e73 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545730.660516:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438146432 00010000:00010000:3.0:1789545730.660518:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff994bc4f9ea00) 00010000:00010000:3.0:1789545730.660525:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789545730.660533:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0e73 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.660542:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0e73 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545730.660599:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 120 00000100:00100000:2.0:1789545730.660623:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+58:10584:x1876474438146432:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789545730.660647:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545730.660665:0:10125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0e7a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de55bc expref: -99 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.660721:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0e7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55bc expref: 59 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.660735:0:10125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0e7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55bc expref: 59 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.660751:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff994bc4f9ea00) 00010000:00010000:2.0:1789545730.660754:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789545730.660758:0:10125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0400, rc 0) 00000100:00100000:2.0:1789545730.660809:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+59:10584:x1876474438146432:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 189us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545730.660827:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 120 00000100:00100000:0.0:1789545730.667578:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545730.669698:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438146560 00000100:00100000:1.0:1789545730.669716:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438146560 00000100:00100000:1.0:1789545730.669800:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 37 00000100:00100000:1.0:1789545730.669813:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bffcd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a8edb7a-f384-4468-93f4-9d664f284862+8:2359:x1876474438146560:12345-192.168.201.16@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789545730.670161:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bffcd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a8edb7a-f384-4468-93f4-9d664f284862+9:2359:x1876474438146560:12345-192.168.201.16@tcp:2:lhsmtool_posix.0 Request processed in 350us (2592us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789545730.670170:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 37 00000100:00080000:0.0:1789545730.670630:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789545730.674926:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545730.675036:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438146816 00000100:00100000:2.0:1789545730.675046:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438146816 00000100:00100000:2.0:1789545730.675113:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 30 00000100:00100000:2.0:1789545730.675123:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bffcdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+59:10584:x1876474438146816:12345-192.168.201.16@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789545730.675730:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bffcdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+60:10584:x1876474438146816:12345-192.168.201.16@tcp:35:lhsmtool_posix.0 Request processed in 606us (810us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1789545730.675740:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 30 00000100:00100000:2.0:1789545730.684867:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545730.684996:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438147072 00000100:00100000:3.0:1789545730.685013:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438147072 00000100:00100000:3.0:1789545730.685108:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 121 00000100:00100000:3.0:1789545730.685122:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf4ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+60:10584:x1876474438147072:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789545730.685299:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf4ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+60:10584:x1876474438147072:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 Request processed in 169us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545730.685308:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 121 00000100:00100000:0.0:1789545730.689028:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545730.693595:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438147200 00000100:00100000:2.0:1789545730.693650:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438147200 00000100:00100000:2.0:1789545730.693754:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 122 00000100:00100000:2.0:1789545730.693768:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bffcd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+60:10584:x1876474438147200:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789545730.693797:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545730.693824:0:10125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0e81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de55c3 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.694355:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0e88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.695225:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0e88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.695241:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0e88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545730.695311:0:10125:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789545730.695339:0:10125:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0e88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.695419:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0e81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55c3 expref: 62 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.695448:0:10125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0e88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55c3 expref: 61 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.695458:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff994bc4f9ea00) 00010000:00010000:2.0:1789545730.695462:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789545730.695467:0:10125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1200, rc 0) 00000100:00100000:2.0:1789545730.695587:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bffcd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+61:10584:x1876474438147200:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 1821us (6572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545730.695613:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 122 00000100:00100000:0.0:1789545730.703980:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545730.704324:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438147328 00000100:00100000:1.0:1789545730.704339:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438147328 00000100:00100000:1.0:1789545730.704454:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 38 00000100:00100000:1.0:1789545730.704467:0:8211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bffcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a8edb7a-f384-4468-93f4-9d664f284862+9:2358:x1876474438147328:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789545730.704495:0:8211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545730.704523:0:8211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb0c3f3/0x64919c0f856c0e8f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de55ca expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789545730.704560:0:8211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aaa4d03, blocks: 0x1 00010000:00010000:1.0:1789545730.704588:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=344s v=(0 0) 00010000:00010000:1.0:1789545730.704613:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789545730.704625:0:8211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb0c3f3/0x64919c0f856c0e8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55ca expref: 10 pid: 8211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545730.704651:0:8211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002fb0c3f3/0x64919c0f856c0e8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55ca expref: 10 pid: 8211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545730.704666:0:8211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba9200, rc 0) 00000100:00100000:1.0:1789545730.704757:0:8211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bffcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a8edb7a-f384-4468-93f4-9d664f284862+10:2358:x1876474438147328:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 292us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545730.704766:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 38 00000100:00100000:1.0:1789545730.713593:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545730.714717:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438147584 00000100:00100000:3.0:1789545730.714734:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438147584 00000100:00100000:3.0:1789545730.714837:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 123 00000100:00100000:3.0:1789545730.714851:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+61:10584:x1876474438147584:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789545730.715025:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+61:10584:x1876474438147584:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 Request processed in 177us (1446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545730.715033:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 123 00000100:00100000:2.0:1789545730.726049:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545730.726483:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438147712 00000100:00100000:1.0:1789545730.726498:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438147712 00000100:00100000:1.0:1789545730.726579:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 39 00000100:00100000:1.0:1789545730.726592:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf4edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a8edb7a-f384-4468-93f4-9d664f284862+10:10584:x1876474438147712:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789545730.726616:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545730.726641:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d687c055/0x64919c0f856c0e96 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de55d1 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545730.726684:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002fb0c3f3/0x64919c0f856c0e8f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55ca expref: 11 pid: 8211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545730.726695:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789545730.726701:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789545730.726707:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d687c055/0x64919c0f856c0e96 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55d1 expref: 11 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545730.726770:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002fb0c3f3/0x64919c0f856c0e8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55ca expref: 11 pid: 8211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545730.726787:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002fb0c3f3/0x64919c0f856c0e8f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55ca expref: 11 pid: 8211 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545730.726805:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f43b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1876474454937344:192.168.201.16@tcp:104: 00000100:00100000:1.0:1789545730.726954:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff994be75f0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789545730.730446:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545730.730654:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f43b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1876474454937344:192.168.201.16@tcp:104: 00010000:00010000:1.0:1789545730.730703:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d687c055/0x64919c0f856c0e96 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55d1 expref: 11 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545730.730730:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba9800, rc 0) 00000100:00100000:1.0:1789545730.730811:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf4edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a8edb7a-f384-4468-93f4-9d664f284862+11:10584:x1876474438147712:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 4221us (4778us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545730.730822:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 39 00000100:00100000:2.0:1789545730.731339:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438147840 00000100:00100000:2.0:1789545730.731349:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438147840 00010000:00010000:2.0:1789545730.731440:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002fb0c3f3/0x64919c0f856c0e8f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55ca expref: 11 pid: 8211 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545730.731473:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 56 00000100:00100000:2.0:1789545730.731483:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+11:2358:x1876474438147840:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789545730.731516:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545730.731548:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002fb0c3f3/0x64919c0f856c0e8f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55ca expref: 11 pid: 8211 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.731564:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002fb0c3f3/0x64919c0f856c0e8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55ca expref: 11 pid: 8211 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.731594:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb0c3f3/0x64919c0f856c0e8f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55ca expref: 11 pid: 8211 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.731615:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545730.731620:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545730.731630:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d687c055/0x64919c0f856c0e96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55d1 expref: 10 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.731643:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d687c055/0x64919c0f856c0e96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55d1 expref: 10 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.731712:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d687c055/0x64919c0f856c0e96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55d1 expref: 10 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545730.731729:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf4edc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5833:1876474454937472:192.168.201.16@tcp:105: 00000100:00100000:2.0:1789545730.731809:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8ce6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789545730.735956:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf4edc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5833:1876474454937472:192.168.201.16@tcp:105: 00010000:00010000:0.0:1789545730.736000:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789545730.737582:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+10:2358:x1876474438147840:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4604us (5654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545730.737601:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 56 00000100:00100000:3.0:1789545730.742596:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545730.744584:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438147968 00000100:00100000:2.0:1789545730.744605:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438147968 00002000:00100000:2.0:1789545730.744686:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff994be4942300 x1876474438147968/t0(0) o4->8a8edb7a-f384-4468-93f4-9d664f284862@192.168.201.16@tcp:196/0 lens 504/0 e 0 to 0 dl 1789545741 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789545730.744700:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994be4942300 with x1876474438147968 ext(0->12) 00002000:00010000:2.0:1789545730.744707:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff994be4942300 00000100:00100000:2.0:1789545730.744830:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2 00000100:00100000:2.0:1789545730.744843:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4942300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8a8edb7a-f384-4468-93f4-9d664f284862+10:2359:x1876474438147968:12345-192.168.201.16@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789545730.745658:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4942300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8a8edb7a-f384-4468-93f4-9d664f284862+12:2359:x1876474438147968:12345-192.168.201.16@tcp:4:lhsmtool_posix.0 Request processed in 812us (3073us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789545730.745670:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2 00002000:00100000:2.0:1789545730.745681:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff994be4942300 x1876474438147968/t4294967308(0) o4->8a8edb7a-f384-4468-93f4-9d664f284862@192.168.201.16@tcp:196/0 lens 504/448 e 0 to 0 dl 1789545741 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789545730.745691:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994be4942300 with x1876474438147968 ext(0->12) 00002000:00010000:2.0:1789545730.745695:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff994be4942300 00000100:00100000:1.0:1789545730.753459:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545730.753621:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438148096 00000100:00100000:3.0:1789545730.753636:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438148096 00000100:00100000:3.0:1789545730.753703:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 124 00000100:00100000:3.0:1789545730.753716:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+61:10584:x1876474438148096:12345-192.168.201.16@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789545730.845970:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967392 is committed 00000001:00080000:2.0:1789545730.846040:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:2.0:1789545730.846067:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff994bd8ce6900 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1789545730.846092:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994bc4b3b700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff994bd8ce6b40 00000020:00080000:2.0:1789545730.846096:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994bc4b3bb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff994be53f2000 00000004:00080000:2.0:1789545730.846136:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:2.0:1789545730.846167:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1789545730.846195:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff994bdfae00c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1789545730.846198:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994ac3545200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff994bdfae0f00 00000020:00080000:2.0:1789545730.846201:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994ac3545e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff994be3cba000 00000004:00080000:2.0:1789545730.846210:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:2.0:1789545730.846433:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789545730.846459:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf4ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454937600:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789545730.846559:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545730.846799:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454937856:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789545730.846836:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545730.846867:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789545730.846872:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4940e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454937728:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789545730.846892:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545730.846923:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454937600 00000100:00100000:3.0:1789545730.846932:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454937600 00000100:00100000:3.0:1789545730.846993:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454937856 00000100:00100000:3.0:1789545730.846996:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454937856 00000100:00100000:3.0:1789545730.847013:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454937728 00000100:00100000:3.0:1789545730.847015:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454937728 00000100:00100000:3.0:1789545730.847030:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789545730.847039:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1876474454937600:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789545730.847078:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:3.0:1789545730.847123:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aaa4d01, atime: 0x6aaa4d01, ctime: 0x6aaa4d01, blocks: 0x1 00010000:00010000:3.0:1789545730.847134:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002817eb8a/0x64919c0f856c0e9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.847154:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=344s v=(0 0) 00010000:00010000:3.0:1789545730.847159:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789545730.847167:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002817eb8a/0x64919c0f856c0e9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.847186:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002817eb8a/0x64919c0f856c0e9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.847198:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002817eb8a/0x64919c0f856c0e9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.847221:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002817eb8a/0x64919c0f856c0e9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.847243:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789545730.848017:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1876474454937600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 973us (1452us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789545730.848029:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789545730.848063:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789545730.848072:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1876474454937856:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789545730.848720:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789545730.848726:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789545731 00002000:00010000:3.0:1789545730.848730:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789545730.848732:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789545731 -> 1789545731 00002000:00010000:3.0:1789545730.848734:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789545730.848788:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3314:x1876474454937856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 718us (1950us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789545730.848796:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789545730.848818:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789545730.848827:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4943480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1876474454937728:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789545730.848846:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:3.0:1789545730.848866:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000406e342/0x64919c0f856c0ea4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.848889:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c0c5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5530 expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.848917:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789545730.848922:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789545730.848927:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000406e342/0x64919c0f856c0ea4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.848969:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c0c5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5530 expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.848986:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c0c5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5530 expref: 11 pid: 6693 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545730.849004:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4942a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1876474454937984:192.168.201.16@tcp:104: 00000100:00100000:3.0:1789545730.849097:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd16889c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789545730.849131:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789545730.849139:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002817eb8a/0x64919c0f856c0e9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.849149:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217f400 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545730.849154:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002817eb8a/0x64919c0f856c0e9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.849166:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002817eb8a/0x64919c0f856c0e9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.849200:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002817eb8a/0x64919c0f856c0e9d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.849208:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002817eb8a/0x64919c0f856c0e9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.849234:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545730.849236:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545730.849238:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789545730.849466:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789545730.849472:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789545730.849520:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff994be4941880/2, rc 0, transno 4294967309 00000100:00100000:3.0:1789545730.849528:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454937856:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1789545730.849563:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff994bdf4ed180/2, rc 0, transno 4294967304 00000100:00100000:3.0:1789545730.849568:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf4ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454937600:0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1789545730.849948:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1789545730.850186:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1789545730.853344:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545730.853510:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438148224 00000100:00100000:2.0:1789545730.853523:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438148224 00010000:00010000:2.0:1789545730.853583:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c0c5f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5530 expref: 12 pid: 6693 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545730.853637:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 57 00000100:00100000:2.0:1789545730.853650:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+12:2358:x1876474438148224:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789545730.853671:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545730.853678:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c0c5f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5530 expref: 12 pid: 6693 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.853694:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c0c5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5530 expref: 12 pid: 6693 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.853752:0:7637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789545730.853758:0:7637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789545730.853765:0:7637:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000406e342/0x64919c0f856c0ea4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.853776:0:7637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000406e342/0x64919c0f856c0ea4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.853806:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789545730.853883:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+12:2358:x1876474438148224:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 225us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545730.853892:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 57 00010000:00010000:3.0:1789545730.854952:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c0c5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5530 expref: 11 pid: 6693 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545730.854977:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4942a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1876474454937984:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545730.855003:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000406e342/0x64919c0f856c0ea4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.855017:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000406e342/0x64919c0f856c0ea4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.855046:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000406e342/0x64919c0f856c0ea4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.855058:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000406e342/0x64919c0f856c0ea4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.855066:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000406e342/0x64919c0f856c0ea4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.855097:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789545730.855584:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789545730.855594:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000406e342/0x64919c0f856c0ea4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.855605:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217f000 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:0.0:1789545730.855609:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000406e342/0x64919c0f856c0ea4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.855620:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000406e342/0x64919c0f856c0ea4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.855643:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000406e342/0x64919c0f856c0ea4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.855651:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000406e342/0x64919c0f856c0ea4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.855689:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545730.855691:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545730.855693:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545730.857202:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+15:10584:x1876474438148096:12345-192.168.201.16@tcp:44:lhsmtool_posix.0 Request processed in 103469us (103737us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545730.857219:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 124 00000100:00100000:3.0:1789545730.857736:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4943480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3314:x1876474454937728:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8907us (10839us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789545730.857746:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:1.0:1789545730.858299:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff994be4940e00/2, rc 0, transno 4294967310 00000100:00100000:1.0:1789545730.858320:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4940e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454937728:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789545730.868884:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545730.868991:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438148352 00000100:00100000:3.0:1789545730.869004:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438148352 00000100:00100000:3.0:1789545730.869095:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 43 00000100:00100000:3.0:1789545730.869110:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a8edb7a-f384-4468-93f4-9d664f284862+11:2360:x1876474438148352:12345-192.168.201.16@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1789545730.877637:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789545730.922910:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:2.0:1789545730.922941:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1789545730.922949:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1789545730.922969:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:0.0:1789545730.923313:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a8edb7a-f384-4468-93f4-9d664f284862+6:2360:x1876474438148352:12345-192.168.201.16@tcp:16:lhsmtool_posix.0 Request processed in 54198us (54435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545730.923328:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 43 00000100:00100000:2.0:1789545730.928055:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545730.928227:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438148608 00000100:00100000:3.0:1789545730.928241:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438148608 00000100:00100000:3.0:1789545730.928758:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 125 00000100:00100000:3.0:1789545730.928774:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+15:10584:x1876474438148608:12345-192.168.201.16@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789545730.928849:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545730.928899:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c0e88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55c3 expref: 15 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.928940:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff994bc4f9ea00) 00010000:00010000:3.0:1789545730.928947:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789545730.928989:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0eab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.929007:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0eab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.929020:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0eab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789545730.930026:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025f07b26 reply state 00000000188ab64a transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0eab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545730.930044:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789545730.930212:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+16:10584:x1876474438148608:12345-192.168.201.16@tcp:36:lhsmtool_posix.0 Request processed in 1440us (2169us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1789545730.930221:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 125 00000100:00100000:1.0:1789545730.934138:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545730.934749:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438148736 00000100:00100000:3.0:1789545730.934763:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438148736 00000100:00100000:3.0:1789545730.934839:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 44 00000100:00100000:3.0:1789545730.934852:0:8211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a8edb7a-f384-4468-93f4-9d664f284862+6:2359:x1876474438148736:12345-192.168.201.16@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789545730.935248:0:8211:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789545730.935252:0:8211:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789545731 -> 1789545729 00002000:00010000:3.0:1789545730.935255:0:8211:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789545729 00002000:00010000:3.0:1789545730.935257:0:8211:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789545731 -> 1789545729 00002000:00010000:3.0:1789545730.935260:0:8211:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789545730.935800:0:8211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a8edb7a-f384-4468-93f4-9d664f284862+7:2359:x1876474438148736:12345-192.168.201.16@tcp:2:lhsmtool_posix.0 Request processed in 946us (1673us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789545730.935811:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 44 00000100:00100000:1.0:1789545730.938708:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545730.938832:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438148992 00000100:00100000:3.0:1789545730.938848:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438148992 00000100:00100000:3.0:1789545730.938941:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 126 00000100:00100000:3.0:1789545730.938954:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+16:10584:x1876474438148992:12345-192.168.201.16@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789545730.939052:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0eb2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.939074:0:10125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0e6c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55b5 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.939097:0:10125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0eb2 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.939145:0:10125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0e6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55b5 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.939161:0:10125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0e6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55b5 expref: 16 pid: 5847 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545730.939181:0:10125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4942a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1876474454938112:192.168.201.16@tcp:104: 00000100:00100000:3.0:1789545730.939321:0:10125:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfae0600 going to sleep for 11 seconds 00000100:00100000:3.0:1789545730.942331:0:10125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4942a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1876474454938112:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545730.942419:0:10125:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0eb2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.942735:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0eab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.942746:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0eab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.942755:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0eab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.942763:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217f400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545730.942777:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0eab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.942786:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0eab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.942807:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff994bc4f9ea00) 00010000:00010000:2.0:1789545730.942811:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545730.942817:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0eab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.942824:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0eab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545730.945141:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545730.945273:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438149120 00000100:00100000:0.0:1789545730.945298:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438149120 00010000:00010000:0.0:1789545730.945405:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0e6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55b5 expref: 16 pid: 5847 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545730.945446:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 58 00000100:00100000:0.0:1789545730.945460:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a8edb7a-f384-4468-93f4-9d664f284862+16:2359:x1876474438149120:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789545730.945479:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789545730.945498:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0e6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55b5 expref: 16 pid: 5847 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.945514:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0e6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55b5 expref: 16 pid: 5847 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.945542:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0e6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55b5 expref: 16 pid: 5847 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.945566:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff994bc4f9ea00) 00010000:00010000:0.0:1789545730.945571:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0eb2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.945600:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0eb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.945611:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0eb2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.945709:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789545730.945790:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a8edb7a-f384-4468-93f4-9d664f284862+15:2359:x1876474438149120:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 332us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545730.945799:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 58 00010000:00010000:3.0:1789545730.947776:0:10125:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0eb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.947799:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0eb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.947843:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0eb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.947852:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0eb2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.947861:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0eb2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.947879:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217e400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545730.947884:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0eb2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.947893:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0eb2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.947914:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff994bc4f9ea00) 00010000:00010000:3.0:1789545730.947917:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789545730.947922:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0eb2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.947929:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0eb2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545730.948045:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+14:10584:x1876474438148992:12345-192.168.201.16@tcp:55:lhsmtool_posix.0 Request processed in 9089us (9351us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789545730.948077:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 126 00000100:00100000:1.0:1789545730.951925:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545730.952021:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438149248 00000100:00100000:0.0:1789545730.952036:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438149248 00000100:00100000:0.0:1789545730.952124:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 45 00000100:00100000:0.0:1789545730.952137:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+7:2361:x1876474438149248:12345-192.168.201.16@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789545730.952201:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008ad00940/0x64919c0f856c0eb9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.952228:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d687c055/0x64919c0f856c0e96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55d1 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.952238:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789545730.952243:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789545730.952249:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ad00940/0x64919c0f856c0eb9 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.952307:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d687c055/0x64919c0f856c0e96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55d1 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.952349:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d687c055/0x64919c0f856c0e96 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55d1 expref: 7 pid: 6692 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545730.952422:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994beddf1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1876474454938240:192.168.201.16@tcp:104: 00000100:00100000:0.0:1789545730.952757:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc591fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789545730.957808:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545730.958408:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438149376 00000100:00100000:2.0:1789545730.958422:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438149376 00010000:00010000:2.0:1789545730.958479:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d687c055/0x64919c0f856c0e96 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55d1 expref: 8 pid: 6692 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545730.958550:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 59 00000100:00100000:2.0:1789545730.958562:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+8:2359:x1876474438149376:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789545730.958582:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545730.958612:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d687c055/0x64919c0f856c0e96 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55d1 expref: 8 pid: 6692 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.958629:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d687c055/0x64919c0f856c0e96 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55d1 expref: 8 pid: 6692 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.958661:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789545730.958685:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789545730.958692:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008ad00940/0x64919c0f856c0eb9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.958704:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ad00940/0x64919c0f856c0eb9 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.958733:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789545730.958805:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+8:2359:x1876474438149376:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 245us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545730.958814:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 59 00010000:00010000:0.0:1789545730.960484:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d687c055/0x64919c0f856c0e96 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55d1 expref: 7 pid: 6692 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545730.960514:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994beddf1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1876474454938240:192.168.201.16@tcp:104: 00010000:00010000:0.0:1789545730.960547:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008ad00940/0x64919c0f856c0eb9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.960561:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008ad00940/0x64919c0f856c0eb9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.960569:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ad00940/0x64919c0f856c0eb9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.960613:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008ad00940/0x64919c0f856c0eb9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.960623:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ad00940/0x64919c0f856c0eb9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.960662:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ad00940/0x64919c0f856c0eb9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.960669:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6400 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:0.0:1789545730.960674:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ad00940/0x64919c0f856c0eb9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.960684:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ad00940/0x64919c0f856c0eb9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.960707:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ad00940/0x64919c0f856c0eb9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.960713:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ad00940/0x64919c0f856c0eb9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545730.960821:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+6:2361:x1876474438149248:12345-192.168.201.16@tcp:1:lhsmtool_posix.0 Request processed in 8686us (8911us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545730.960831:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 45 00000100:00100000:1.0:1789545730.963841:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545730.964031:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438149632 00000100:00100000:2.0:1789545730.964044:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438149632 00000100:00100000:2.0:1789545730.964224:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 127 00000100:00100000:2.0:1789545730.964237:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+14:10584:x1876474438149632:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789545730.964395:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0ec0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.964421:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0ec0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.964434:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0ec0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.964722:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0ec7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.964735:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0e7a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55bc expref: 15 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.964771:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0ec7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.964820:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0e7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55bc expref: 15 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545730.964837:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0e7a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55bc expref: 15 pid: 10125 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545730.964855:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be76cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876474454938368:192.168.201.16@tcp:104: 00000100:00100000:2.0:1789545730.965240:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8ce6180 going to sleep for 11 seconds 00000100:00100000:2.0:1789545730.975909:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545730.976642:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be76cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876474454938368:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545730.976684:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0ec7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545730.977060:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438149760 00000100:00100000:0.0:1789545730.977071:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438149760 00010000:00010000:0.0:1789545730.977204:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0e7a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55bc expref: 16 pid: 10125 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545730.977304:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 60 00000100:00100000:0.0:1789545730.977336:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a8edb7a-f384-4468-93f4-9d664f284862+16:2358:x1876474438149760:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789545730.977388:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789545730.977399:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0e7a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55bc expref: 16 pid: 10125 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.977415:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0e7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55bc expref: 16 pid: 10125 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.977443:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c0e7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55bc expref: 16 pid: 10125 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.977464:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff994bc4f9ea00) 00010000:00010000:0.0:1789545730.977470:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0ec7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.977481:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0ec7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.977490:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0ec7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.977525:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789545730.977600:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a8edb7a-f384-4468-93f4-9d664f284862+15:2358:x1876474438149760:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 265us (1706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545730.977609:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 60 00010000:00010000:3.0:1789545730.977962:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0ec7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545730.977972:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0ec7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789545730.978228:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1789545730.978455:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1789545730.978512:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1789545730.978650:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4942a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1876474454938496:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789545730.978728:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545730.978787:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfc40840 going to sleep for 11 seconds 00000100:00100000:1.0:1789545730.979280:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454938496 00000100:00100000:1.0:1789545730.979302:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454938496 00000100:00100000:1.0:1789545730.979393:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789545730.979406:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf6c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876474454938496:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789545730.979536:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf6c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876474454938496:12345-0@lo:1000:mdt00_000.0 Request processed in 133us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545730.979544:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789545730.979597:0:5846:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1789545730.979606:0:5846:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:1.0:1789545730.979632:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff994be4941880, transno 4294967309 00000004:00080000:1.0:1789545730.979640:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff994be4940e00, transno 4294967310 00000100:00100000:1.0:1789545730.979649:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4942a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1876474454938496:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1789545730.980306:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1789545730.980437:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f40000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1876474454938624:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789545730.980500:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545730.980550:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454938624 00000100:00100000:1.0:1789545730.980556:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454938624 00000100:00100000:1.0:1789545730.980589:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789545730.980599:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876474454938624:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789545730.980818:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1876474454938624:12345-0@lo:1000:mdt00_000.0 Request processed in 221us (318us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789545730.980827:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789545730.980852:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdf604e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789545730.980883:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f40000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1876474454938624:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1789545730.980927:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0ec7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545730.980939:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0ec7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545730.980948:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0ec7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545730.980954:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0c00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545730.980961:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0ec7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545730.980970:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0ec7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545730.980989:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff994bc4f9ea00) 00010000:00010000:1.0:1789545730.980992:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789545730.980998:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0ec7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545730.981004:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c0ec7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545730.981042:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0e0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545730.981056:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0e0a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545730.981062:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0e0a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545730.981067:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb7000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545730.981070:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0e0a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545730.981076:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0e0a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545730.981084:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:1.0:1789545730.981087:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789545730.981095:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0e11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55a0 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545730.981109:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0e11 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55a0 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545730.981120:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0e11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55a0 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545730.981164:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0e11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55a0 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545730.981176:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876474454938752:192.168.201.16@tcp:105: 00000100:00100000:1.0:1789545730.981259:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff994ac2b53cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789545730.985962:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545730.986000:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438149888 00000100:00100000:3.0:1789545730.986011:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438149888 00000100:00100000:3.0:1789545730.986083:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 31 00000100:00100000:3.0:1789545730.986446:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf6c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+19:10583:x1876474438149888:12345-192.168.201.16@tcp:49:lfs.0 00000100:00100000:3.0:1789545730.986627:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf6c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+19:10583:x1876474438149888:12345-192.168.201.16@tcp:49:lfs.0 Request processed in 190us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545730.986636:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 31 00000100:00100000:0.0:1789545730.987561:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876474454938752:192.168.201.16@tcp:105: 00010000:00010000:0.0:1789545730.987596:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0e0a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.987629:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c0e0a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.987669:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0ece lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.987690:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0ece lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.987704:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0ece lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.987717:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0ece lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.987725:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0ece lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.987732:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0ece lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.987738:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545730.987742:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0ece lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.987751:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0ece lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.987765:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:0.0:1789545730.987768:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545730.987772:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0ece lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.987786:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0ece lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.987797:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0ec0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.987804:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0ec0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.987811:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0ec0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.987817:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545730.987820:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0ec0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.987825:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0ec0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.987834:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:0.0:1789545730.987836:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789545730.987840:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0ec0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545730.987845:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c0ec0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789545730.988413:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789545730.988420:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789545730.988923:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789545730.988935:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789545730.989416:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+18:10584:x1876474438149632:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 Request processed in 25112us (25518us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1789545730.989433:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 127 00000020:00080000:0.0:1789545730.989452:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1789545730.997202:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545730.997333:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545730.997570:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438150400 00000100:00100000:3.0:1789545730.997585:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438150400 00000100:00100000:3.0:1789545730.997654:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 32 00000100:00100000:3.0:1789545730.997667:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8cc6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+18:10584:x1876474438150400:12345-192.168.201.16@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789545730.999730:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438150144 00000100:00100000:1.0:1789545730.999749:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438150144 00000100:00100000:1.0:1789545730.999827:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 128 00000100:00100000:1.0:1789545730.999840:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+20:10583:x1876474438150144:12345-192.168.201.16@tcp:58:lfs.0 00000040:00080000:1.0:1789545731.000299:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1789545731.000457:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+20:10583:x1876474438150144:12345-192.168.201.16@tcp:58:lfs.0 Request processed in 617us (3270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545731.000466:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 128 00000004:00080000:0.0:1789545731.006094:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789545731.006234:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1789545731.006349:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0ed5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545731.006657:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0ed5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545731.006672:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0ed5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545731.006683:0:5850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0ed5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545731.006689:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0ed5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545731.006695:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0ed5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545731.008687:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789545731.008894:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8cc6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+20:10584:x1876474438150400:12345-192.168.201.16@tcp:35:lhsmtool_posix.0 Request processed in 11220us (11551us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1789545731.008908:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 32 00000020:00080000:1.0:1789545731.008918:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789545731.013460:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789545731.013481:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0ed5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.013509:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6000 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545731.013515:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0ed5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.013528:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0ed5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.013553:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff994bc4f11000) 00010000:00010000:3.0:1789545731.013557:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789545731.013563:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0ed5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.013569:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0ed5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.013608:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545731.013610:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545731.013612:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545731.035241:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545731.035414:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438150528 00000100:00100000:3.0:1789545731.035428:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438150528 00000100:00100000:3.0:1789545731.035515:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 129 00000100:00100000:3.0:1789545731.035547:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+20:10586:x1876474438150528:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:3.0:1789545731.035582:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545731.035609:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0edc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de55d8 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.035699:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ee3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.035718:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ee3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.035732:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ee3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.035753:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0eea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.035760:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0eea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.035767:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0eea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.036072:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0ef1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.036086:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0dfc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5599 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.036094:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0ef1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.036147:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0dfc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5599 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.036160:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0dfc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5599 expref: 21 pid: 5846 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545731.036173:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf6c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1876474454938880:192.168.201.16@tcp:104: 00000100:00100000:3.0:1789545731.036268:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfc403c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789545731.038854:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf6c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1876474454938880:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545731.038904:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0ef1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545731.039808:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545731.040326:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438150784 00000100:00100000:0.0:1789545731.040338:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438150784 00000100:00100000:0.0:1789545731.040448:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 33 00000100:00100000:0.0:1789545731.040457:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+22:5594:x1876474438150784:12345-192.168.201.16@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789545731.040764:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+23:5594:x1876474438150784:12345-192.168.201.16@tcp:35:ldlm_bl.0 Request processed in 306us (960us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1789545731.040774:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 33 00000100:00100000:2.0:1789545731.042717:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545731.042955:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438150912 00000100:00100000:1.0:1789545731.042968:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438150912 00010000:00010000:1.0:1789545731.043017:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0dfc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5599 expref: 23 pid: 5846 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545731.043062:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 61 00000100:00100000:1.0:1789545731.043073:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd9366c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a8edb7a-f384-4468-93f4-9d664f284862+23:2358:x1876474438150912:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789545731.043197:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545731.043207:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0dfc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5599 expref: 23 pid: 5846 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545731.043222:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0dfc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5599 expref: 23 pid: 5846 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545731.043263:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c0dfc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5599 expref: 23 pid: 5846 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545731.043296:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:1.0:1789545731.043302:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0ef1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545731.043313:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545731.043322:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0ef1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545731.043473:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789545731.043542:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd9366c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a8edb7a-f384-4468-93f4-9d664f284862+22:2358:x1876474438150912:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 469us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545731.043551:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 61 00010000:00010000:3.0:1789545731.044715:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.044732:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545731.044794:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789545731.044799:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789545731.044821:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.044837:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.044846:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ee3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.044879:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ee3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.044885:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ee3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.044891:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217f600 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545731.044894:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ee3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.044900:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ee3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.044911:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:3.0:1789545731.044913:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545731.044916:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ee3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.044920:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ee3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.044941:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0eea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.044946:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0eea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.044952:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0eea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.044957:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217fe00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545731.044966:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0eea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.044973:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0eea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.044982:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff994bc4f9ec00) 00010000:00010000:3.0:1789545731.044985:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545731.044988:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0eea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.044993:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0eea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.045032:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0edc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55d8 expref: 22 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.045045:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55d8 expref: 21 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545731.045050:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:3.0:1789545731.045052:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789545731.045054:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217f400, rc 0) 00000100:00100000:3.0:1789545731.045139:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+21:10586:x1876474438150528:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 9595us (9912us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545731.045146:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 129 00010000:00010000:0.0:1789545731.906997:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789545731.964134:0:12117:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789545731.964150:0:12117:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789545731.964201:0:12117:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789545731.964208:0:12117:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789545732.031420:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789545732.031431:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789545732.031472:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789545732.031479:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789545732.031646:0:11700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54a1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1876474454939008:192.168.201.16@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789545732.031777:0:11700:0:(client.c:2716:ptlrpc_set_wait()) set ffff994ac2b53000 going to sleep for 11 seconds 00000100:00100000:1.0:1789545732.034208:0:11700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54a1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1876474454939008:192.168.201.16@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789545732.035694:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545732.035904:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438151040 00000100:00100000:3.0:1789545732.035919:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438151040 00000100:00100000:3.0:1789545732.036027:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 130 00000100:00100000:3.0:1789545732.036040:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+21:10598:x1876474438151040:12345-192.168.201.16@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789545732.036171:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789545732.036770:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+21:10598:x1876474438151040:12345-192.168.201.16@tcp:53:lhsmtool_posix.0 Request processed in 729us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545732.036780:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 130 00000100:00080000:1.0:1789545732.036911:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789545732.040204:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545732.045511:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438151296 00000100:00100000:1.0:1789545732.045534:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438151296 00000100:00100000:1.0:1789545732.045674:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 131 00000100:00100000:1.0:1789545732.045687:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf6c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+21:10598:x1876474438151296:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789545732.045716:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545732.045743:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c0ef8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de55df expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545732.045890:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0eff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545732.045909:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0eff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545732.045922:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0eff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789545732.045936:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789545732.046114:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c0ef8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55df expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545732.046135:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0eff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55df expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545732.046144:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:1.0:1789545732.046147:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789545732.046151:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba8800, rc 0) 00000100:00100000:1.0:1789545732.046259:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf6c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+23:10598:x1876474438151296:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 575us (6071us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1789545732.046278:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 131 00000100:00100000:2.0:1789545732.053396:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545732.053489:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438151552 00000100:00100000:1.0:1789545732.053503:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438151552 00000100:00100000:1.0:1789545732.053572:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 132 00000100:00100000:1.0:1789545732.053585:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+23:10598:x1876474438151552:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789545732.053702:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c0f0d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545732.053724:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c0f0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545732.053739:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c0f0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545732.054008:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c0f0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545732.054016:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c0f0d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545732.054024:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c0f0d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545732.054031:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba9000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545732.054037:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c0f0d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545732.054046:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c0f0d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545732.054080:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:1.0:1789545732.054084:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789545732.054091:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c0f0d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545732.054099:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c0f0d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545732.054311:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+24:10598:x1876474438151552:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 Request processed in 726us (961us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1789545732.054323:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 132 00000040:00080000:2.0:1789545732.054623:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789545732.054629:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789545732.055106:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789545732.055118:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789545732.056842:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545732.056981:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438151680 00000100:00100000:3.0:1789545732.056995:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438151680 00000100:00100000:3.0:1789545732.057084:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8 00000100:00100000:3.0:1789545732.057097:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+24:2358:x1876474438151680:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789545732.057116:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545732.057148:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0eff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55df expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545732.057174:0:7637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:3.0:1789545732.057180:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545732.057257:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+23:2358:x1876474438151680:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 162us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545732.057273:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8 00000100:00100000:3.0:1789545732.059479:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545732.059694:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438151936 00000100:00100000:2.0:1789545732.059707:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438151936 00000100:00100000:2.0:1789545732.059779:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 34 00000100:00100000:2.0:1789545732.059792:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+23:10598:x1876474438151936:12345-192.168.201.16@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789545732.060145:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+24:10598:x1876474438151936:12345-192.168.201.16@tcp:35:lhsmtool_posix.0 Request processed in 355us (678us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1789545732.060154:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 34 00010000:00010000:2.0:1789545732.925006:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545733.693256:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be76c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454939136:0@lo:400:kworker.0 00000100:00100000:2.0:1789545733.693401:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545733.693469:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be76c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454939648:0@lo:400:kworker.0 00000100:00100000:2.0:1789545733.693502:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545733.693538:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789545733.693546:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be76c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454939264:0@lo:400:kworker.0 00000100:00100000:2.0:1789545733.693569:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545733.693588:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be76c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454939776:0@lo:400:kworker.0 00000100:00100000:2.0:1789545733.693615:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545733.693645:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be76cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454939392:0@lo:400:kworker.0 00000100:00100000:2.0:1789545733.693671:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545733.693691:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789545733.693698:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be76c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454939520:0@lo:400:kworker.0 00000100:00100000:2.0:1789545733.693722:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545733.693775:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454939136 00000100:00100000:2.0:1789545733.693785:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454939136 00000100:00100000:1.0:1789545733.694021:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454939648 00000100:00100000:1.0:1789545733.694026:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454939648 00000100:00100000:1.0:1789545733.694082:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454939264 00000100:00100000:1.0:1789545733.694085:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454939264 00000100:00100000:1.0:1789545733.694099:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454939392 00000100:00100000:1.0:1789545733.694102:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454939392 00000100:00100000:1.0:1789545733.694122:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789545733.694133:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454939648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545733.694206:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454939648:12345-0@lo:400:kworker.0 Request processed in 74us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545733.694214:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789545733.694243:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789545733.694250:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454939264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545733.694281:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454939264:12345-0@lo:400:kworker.0 Request processed in 32us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545733.694288:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789545733.694316:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789545733.694323:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454939392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545733.694375:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454939392:12345-0@lo:400:kworker.0 Request processed in 38us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545733.694381:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:1.0:1789545733.694403:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789545733.694447:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be76cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454939392:0@lo:400:kworker.0 00000100:00100000:1.0:1789545733.694484:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be76c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454939264:0@lo:400:kworker.0 00000100:00100000:1.0:1789545733.694496:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be76c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454939648:0@lo:400:kworker.0 00000100:00100000:0.0:1789545733.695090:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454939776 00000100:00100000:0.0:1789545733.695099:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454939776 00000100:00100000:0.0:1789545733.695151:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454939520 00000100:00100000:0.0:1789545733.695155:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454939520 00000100:00100000:0.0:1789545733.695180:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789545733.695190:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1876474454939776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545733.695268:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1876474454939776:12345-0@lo:400:kworker.0 Request processed in 81us (1651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545733.695275:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789545733.695294:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789545733.695300:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1876474454939520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545733.695338:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1876474454939520:12345-0@lo:400:kworker.0 Request processed in 38us (1614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545733.695344:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1789545733.695594:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789545733.695599:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789545733.695636:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be76c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454939520:0@lo:400:kworker.0 00000100:00100000:0.0:1789545733.695677:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be76c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454939776:0@lo:400:kworker.0 00000100:00100000:2.0:1789545733.698139:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1789545733.698162:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454939136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545733.698311:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454939136:12345-0@lo:400:kworker.0 Request processed in 158us (4951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545733.698320:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1789545733.698423:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be76c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454939136:0@lo:400:kworker.0 00000001:00080000:1.0:1789545733.749869:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1789545733.750223:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:1.0:1789545733.750253:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000040:00080000:1.0:1789545733.901478:0:12170:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789545733.901493:0:12170:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789545733.901550:0:12170:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789545733.901559:0:12170:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789545733.948551:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545734.124800:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545734.125309:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438152192 00000100:00100000:3.0:1789545734.125323:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438152192 00000100:00100000:3.0:1789545734.125456:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 133 00000100:00100000:3.0:1789545734.125468:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+24:10619:x1876474438152192:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:3.0:1789545734.125515:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545734.125542:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0f14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de55e6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545734.125700:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0f1b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545734.125718:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0f1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545734.125733:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0f1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545734.125748:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789545734.125914:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c0f14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55e6 expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545734.125937:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0f1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55e6 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545734.125946:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:3.0:1789545734.125949:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789545734.125953:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217fe00, rc 0) 00000100:00100000:3.0:1789545734.126037:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+26:10619:x1876474438152192:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 571us (1253us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1789545734.126046:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 133 00000100:00080000:2.0:1789545734.127147:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789545734.135354:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545734.135498:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438152320 00000100:00100000:3.0:1789545734.135515:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438152320 00000100:00100000:3.0:1789545734.135595:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 134 00000100:00100000:3.0:1789545734.135608:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+26:10619:x1876474438152320:12345-192.168.201.16@tcp:54:lfs.0 00010000:00010000:3.0:1789545734.135707:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0f29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545734.135737:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545734.135754:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545734.135792:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545734.135800:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0f29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545734.135808:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0f29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545734.135815:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217f600 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545734.135820:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0f29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545734.135829:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0f29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545734.135845:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:3.0:1789545734.135848:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789545734.135856:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0f29 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545734.135863:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0f29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545734.135960:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+26:10619:x1876474438152320:12345-192.168.201.16@tcp:54:lfs.0 Request processed in 354us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545734.135973:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 134 00000100:00100000:0.0:1789545734.207020:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be76c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454939904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789545734.207124:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545734.207241:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789545734.207249:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454940032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789545734.207278:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545734.207455:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454939904 00000100:00100000:3.0:1789545734.207467:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454939904 00000100:00100000:3.0:1789545734.207533:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454940032 00000100:00100000:3.0:1789545734.207537:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454940032 00000100:00100000:3.0:1789545734.207556:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789545734.207567:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876474454939904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789545734.207614:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789545734.207679:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876474454939904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545734.207687:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789545734.207708:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789545734.207714:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454940032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789545734.207738:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789545734.207769:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454940032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545734.207775:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789545734.208080:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1789545734.208088:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1789545734.208117:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff994bdf4ed180, transno 4294967304 00000100:00100000:0.0:1789545734.208147:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454940032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789545734.208166:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be76c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454939904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789545734.230848:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545734.230983:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438152448 00000100:00100000:0.0:1789545734.230996:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438152448 00000100:00100000:0.0:1789545734.231100:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 46 00000100:00100000:0.0:1789545734.231111:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4940e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+6:2358:x1876474438152448:12345-192.168.201.16@tcp:101:cat.0 00010000:00010000:0.0:1789545734.231134:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545734.231161:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048144db1/0x64919c0f856c0f30 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de55ed expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789545734.231195:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aaa4d01, atime: 0x6aaa4d01, ctime: 0x6aaa4d01, blocks: 0xb 00010000:00010000:0.0:1789545734.231221:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789545734.231236:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789545734.231248:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048144db1/0x64919c0f856c0f30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55ed expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545734.231272:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000048144db1/0x64919c0f856c0f30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55ed expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545734.231289:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb7800, rc 0) 00000100:00100000:0.0:1789545734.231419:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4940e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+7:2358:x1876474438152448:12345-192.168.201.16@tcp:101:cat.0 Request processed in 310us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545734.231427:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 46 00000100:00080000:2.0:1789545734.233017:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789545734.235784:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545734.236142:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438152576 00000100:00100000:1.0:1789545734.236157:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438152576 00002000:00100000:1.0:1789545734.236223:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff994be4941880 x1876474438152576/t0(0) o3->8a8edb7a-f384-4468-93f4-9d664f284862@192.168.201.16@tcp:200/0 lens 488/0 e 0 to 0 dl 1789545745 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789545734.236245:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994be4941880 with x1876474438152576 ext(0->4095) 00002000:00010000:1.0:1789545734.236252:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff994be4941880 00000100:00100000:1.0:1789545734.236293:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3 00000100:00100000:1.0:1789545734.236305:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8a8edb7a-f384-4468-93f4-9d664f284862+7:2359:x1876474438152576:12345-192.168.201.16@tcp:3:cat.0 00000100:00100000:1.0:1789545734.236679:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8a8edb7a-f384-4468-93f4-9d664f284862+7:2359:x1876474438152576:12345-192.168.201.16@tcp:3:cat.0 Request processed in 375us (908us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789545734.236707:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3 00002000:00100000:1.0:1789545734.236715:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff994be4941880 x1876474438152576/t0(0) o3->8a8edb7a-f384-4468-93f4-9d664f284862@192.168.201.16@tcp:200/0 lens 488/4536 e 0 to 0 dl 1789545745 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789545734.236723:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994be4941880 with x1876474438152576 ext(0->4095) 00002000:00010000:1.0:1789545734.236726:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff994be4941880 00000100:00100000:1.0:1789545734.586171:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545734.586235:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545734.586287:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545734.586449:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438152960 00000100:00100000:0.0:1789545734.586463:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438152960 00000100:00100000:0.0:1789545734.586568:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 139 00000100:00100000:0.0:1789545734.586581:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2360:x1876474438152960:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:0.0:1789545734.586676:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2360:x1876474438152960:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 97us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545734.586702:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 139 00000100:00100000:3.0:1789545734.587113:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438152704 00000100:00100000:3.0:1789545734.587121:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438152704 00000100:00100000:3.0:1789545734.587163:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 290 00000100:00100000:3.0:1789545734.587171:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2360:x1876474438152704:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:3.0:1789545734.587212:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2360:x1876474438152704:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 42us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545734.587233:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 290 00000100:00100000:2.0:1789545734.587835:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438152832 00000100:00100000:2.0:1789545734.587842:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438152832 00000100:00100000:2.0:1789545734.587892:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 78 00000100:00100000:2.0:1789545734.587900:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+5:2360:x1876474438152832:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545734.587949:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+5:2360:x1876474438152832:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 51us (1662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545734.587956:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 78 00000100:00080000:1.0:1789545734.588606:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789545734.588613:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789545734.972825:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545735.996671:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789545736.124626:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789545736.124636:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789545736.124672:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789545736.124679:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1789545736.296041:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:3.0:1789545736.296061:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1789545736.323996:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967409 is committed 00000001:00080000:0.0:1789545736.324092:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:0.0:1789545736.324108:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff994bdf604900 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1789545736.324113:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994bdf68b700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff994bdf6046c0 00000020:00080000:0.0:1789545736.324117:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994bdf68b600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff994bdfb46000 00000020:00080000:1.0:1789545736.324154:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 1 00000020:00080000:1.0:1789545736.324409:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1789545736.324562:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:0.0:1789545736.324678:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000001:00080000:0.0:1789545736.324842:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00010000:00010000:2.0:1789545737.023647:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545738.054485:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545738.815423:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454940160:0@lo:400:kworker.0 00000100:00100000:1.0:1789545738.815501:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545738.815549:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454940672:0@lo:400:kworker.0 00000100:00100000:1.0:1789545738.815578:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545738.815603:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789545738.815610:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454940288:0@lo:400:kworker.0 00000100:00100000:1.0:1789545738.815631:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545738.815648:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454940800:0@lo:400:kworker.0 00000100:00100000:1.0:1789545738.815674:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545738.815706:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454940416:0@lo:400:kworker.0 00000100:00100000:1.0:1789545738.815729:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545738.815748:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789545738.815753:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454940544:0@lo:400:kworker.0 00000100:00100000:1.0:1789545738.815850:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545738.815882:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454940160 00000100:00100000:1.0:1789545738.815890:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454940160 00000100:00100000:1.0:1789545738.815930:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1789545738.815939:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454940160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545738.815990:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454940160:12345-0@lo:400:kworker.0 Request processed in 52us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545738.815996:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1789545738.816027:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454940672 00000100:00100000:1.0:1789545738.816031:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454940672 00000100:00100000:1.0:1789545738.816065:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454940288 00000100:00100000:1.0:1789545738.816068:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454940288 00000100:00100000:1.0:1789545738.816079:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454940416 00000100:00100000:1.0:1789545738.816082:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454940416 00000100:00100000:1.0:1789545738.816095:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789545738.816102:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454940672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545738.816134:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454940672:12345-0@lo:400:kworker.0 Request processed in 32us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545738.816140:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789545738.816163:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789545738.816170:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454940288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545738.816197:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454940288:12345-0@lo:400:kworker.0 Request processed in 28us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545738.816203:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789545738.816216:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789545738.816222:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454940416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545738.816252:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454940416:12345-0@lo:400:kworker.0 Request processed in 31us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545738.816265:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789545738.816284:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454940800 00000100:00100000:1.0:1789545738.816288:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454940800 00000100:00100000:1.0:1789545738.816312:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454940544 00000100:00100000:1.0:1789545738.816315:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454940544 00000100:00100000:1.0:1789545738.816333:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789545738.816339:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454940800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545738.816392:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454940800:12345-0@lo:400:kworker.0 Request processed in 53us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545738.816397:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789545738.816408:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789545738.816414:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454940544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545738.816437:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454940544:12345-0@lo:400:kworker.0 Request processed in 24us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545738.816442:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789545738.816478:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454940288:0@lo:400:kworker.0 00000100:00100000:1.0:1789545738.816489:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454940800:0@lo:400:kworker.0 00000100:00100000:1.0:1789545738.816496:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454940160:0@lo:400:kworker.0 00000100:00100000:1.0:1789545738.816505:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454940672:0@lo:400:kworker.0 00000100:00080000:1.0:1789545738.816534:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789545738.816538:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789545738.816541:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789545738.816557:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1789545738.816562:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1789545738.816577:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454940544:0@lo:400:kworker.0 00000100:00100000:1.0:1789545738.816595:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454940416:0@lo:400:kworker.0 00010000:00010000:2.0:1789545739.074981:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545739.326510:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be479b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454940928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789545739.326603:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545739.327435:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454940928 00000100:00100000:3.0:1789545739.327443:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454940928 00000100:00100000:3.0:1789545739.327496:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789545739.327505:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454940928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789545739.327543:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789545739.327608:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454940928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545739.327615:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789545739.327758:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be479b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454940928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789545739.327780:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789545739.327788:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4942d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454941056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789545739.327819:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545739.327855:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454941056 00000100:00100000:3.0:1789545739.327859:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454941056 00000100:00100000:3.0:1789545739.327880:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789545739.327886:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be479b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454941056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789545739.327907:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789545739.328064:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be479b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454941056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 178us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545739.328071:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789545739.328104:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4942d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454941056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789545739.432481:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545739.433009:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438153088 00000100:00100000:1.0:1789545739.433020:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438153088 00000100:00100000:1.0:1789545739.433161:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 135 00000100:00100000:1.0:1789545739.433172:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+13:10263:x1876474438153088:12345-192.168.201.16@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789545739.433293:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+13:10263:x1876474438153088:12345-192.168.201.16@tcp:60:lhsmtool_posix.0 Request processed in 122us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545739.433300:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 135 00000100:00080000:2.0:1789545739.434271:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789545739.452294:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545739.452466:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438153344 00000100:00100000:1.0:1789545739.452478:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438153344 00000100:00100000:1.0:1789545739.452602:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 35 00000100:00100000:1.0:1789545739.452615:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+13:10263:x1876474438153344:12345-192.168.201.16@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789545739.453170:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+14:10263:x1876474438153344:12345-192.168.201.16@tcp:35:lhsmtool_posix.0 Request processed in 556us (887us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1789545739.453179:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 35 00000100:00100000:0.0:1789545739.713012:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545739.713063:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545739.713091:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545739.713108:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438153472 00000100:00100000:2.0:1789545739.713120:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438153472 00000100:00100000:0.0:1789545739.713141:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545739.713170:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438153856 00000100:00100000:0.0:1789545739.713174:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438153856 00000100:00100000:2.0:1789545739.713185:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 292 00000100:00100000:2.0:1789545739.713195:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2361:x1876474438153472:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:0.0:1789545739.713213:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 143 00000100:00100000:0.0:1789545739.713220:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2361:x1876474438153856:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545739.713290:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438153728 00000100:00100000:1.0:1789545739.713295:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438153728 00000100:00100000:1.0:1789545739.713324:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438153600 00000100:00100000:1.0:1789545739.713327:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438153600 00000100:00100000:1.0:1789545739.713348:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 81 00000100:00100000:1.0:1789545739.713355:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+5:2361:x1876474438153728:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:0.0:1789545739.713418:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2361:x1876474438153856:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 197us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545739.713426:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 143 00000100:00100000:3.0:1789545739.713487:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 82 00000100:00100000:3.0:1789545739.713511:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+6:2361:x1876474438153600:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545739.717691:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+5:2361:x1876474438153728:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 4320us (4611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545739.717708:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 81 00000100:00080000:1.0:1789545739.717795:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789545739.717817:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789545739.717821:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789545739.719645:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2361:x1876474438153472:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 6439us (6630us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545739.719661:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 292 00000100:00100000:3.0:1789545739.720801:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+6:2361:x1876474438153600:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 7284us (7700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545739.720814:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 82 00010000:00010000:2.0:1789545740.092636:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545741.117956:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789545741.442224:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1789545741.442239:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1789545741.442254:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1789545741.442270:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:02000400:2.0:1789545741.601146:0:12373:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 04:02:20 (1789545740) 00010000:00010000:2.0:1789545742.141566:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545743.164975:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545743.304575:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545743.304687:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438154112 00000100:00100000:1.0:1789545743.304697:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438154112 00000100:00100000:1.0:1789545743.304774:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 136 00000100:00100000:1.0:1789545743.304786:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+13:11330:x1876474438154112:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789545743.304818:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545743.304838:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c0f37 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de55f4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545743.304910:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0f3e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545743.304924:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0f3e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545743.304935:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0f3e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545743.304949:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0f45 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545743.304955:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0f45 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545743.304962:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0f45 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545743.305437:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c0f4c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545743.305447:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c0f4c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545743.305463:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c0f4c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789545743.305474:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789545743.305624:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0f3e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545743.305632:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0f3e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545743.305640:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0f3e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545743.305646:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba8800 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545743.305650:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0f3e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545743.305658:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0f3e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545743.305670:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff994bc4f11d00) 00010000:00010000:1.0:1789545743.305673:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545743.305678:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0f3e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545743.305684:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0f3e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545743.305696:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0f45 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545743.305702:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0f45 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545743.305717:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0f45 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545743.305721:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba8400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545743.305724:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0f45 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545743.305731:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0f45 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545743.305739:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff994bc4ffe700) 00010000:00010000:1.0:1789545743.305742:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545743.305744:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0f45 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545743.305750:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0f45 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789545743.305894:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789545743.306716:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c0f37 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55f4 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545743.306736:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c0f4c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55f4 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545743.306743:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff994bc4f11700) 00010000:00010000:1.0:1789545743.306746:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545743.306749:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba9c00, rc 0) 00000100:00100000:1.0:1789545743.306828:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+15:11330:x1876474438154112:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 2044us (2260us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1789545743.306846:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 136 00000100:00100000:3.0:1789545743.312093:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545743.312168:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545743.312203:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438154240 00000100:00100000:0.0:1789545743.312214:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438154240 00000100:00100000:0.0:1789545743.312275:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 137 00000100:00100000:0.0:1789545743.312286:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc641f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+15:11330:x1876474438154240:12345-192.168.201.16@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789545743.312442:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc641f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+15:11330:x1876474438154240:12345-192.168.201.16@tcp:59:lhsmtool_posix.0 Request processed in 158us (2081us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545743.312450:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 137 00000100:00100000:2.0:1789545743.312914:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438154368 00000100:00100000:2.0:1789545743.312920:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438154368 00000100:00100000:2.0:1789545743.312997:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9 00000100:00100000:2.0:1789545743.313006:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc641ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+15:2360:x1876474438154368:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789545743.313018:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545743.313043:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c0f4c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55f4 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545743.313072:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff994bc4f11700) 00010000:00010000:2.0:1789545743.313078:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789545743.313118:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc641ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+14:2360:x1876474438154368:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 113us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545743.313125:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9 00000100:00100000:1.0:1789545743.932980:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876474454941312:0@lo:400:kworker.0 00000100:00100000:1.0:1789545743.933102:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545743.933169:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454941824:0@lo:400:kworker.0 00000100:00100000:1.0:1789545743.933198:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545743.933236:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789545743.933242:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454941184:0@lo:400:kworker.0 00000100:00100000:1.0:1789545743.933279:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545743.933300:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454941696:0@lo:400:kworker.0 00000100:00100000:1.0:1789545743.933327:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545743.933606:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454941312 00000100:00100000:0.0:1789545743.933620:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454941312 00000100:00100000:0.0:1789545743.933681:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454941696 00000100:00100000:0.0:1789545743.933685:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454941696 00000100:00100000:0.0:1789545743.933719:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789545743.933730:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876474454941312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545743.933811:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876474454941312:12345-0@lo:400:kworker.0 Request processed in 83us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545743.933818:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789545743.934995:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454941568:0@lo:400:kworker.0 00000100:00100000:1.0:1789545743.935095:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545743.935161:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789545743.935175:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876474454941440:0@lo:400:kworker.0 00000100:00100000:1.0:1789545743.935204:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545743.935243:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454941824 00000100:00100000:1.0:1789545743.935252:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454941824 00000100:00100000:1.0:1789545743.935311:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454941568 00000100:00100000:1.0:1789545743.935314:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454941568 00000100:00100000:1.0:1789545743.935342:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789545743.935353:0:8211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454941824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545743.935537:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454941440 00000100:00100000:3.0:1789545743.935544:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454941440 00000100:00100000:3.0:1789545743.935578:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789545743.935586:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454941696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545743.935597:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789545743.935609:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876474454941440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545743.937759:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876474454941440:12345-0@lo:400:kworker.0 Request processed in 2140us (2539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545743.937776:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789545743.937863:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789545743.937879:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454941568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545743.937948:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454941568:12345-0@lo:400:kworker.0 Request processed in 77us (2855us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545743.937955:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1789545743.938003:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789545743.938009:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789545743.938013:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789545743.938127:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454941696:0@lo:400:kworker.0 00000100:00100000:0.0:1789545743.938146:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876474454941312:0@lo:400:kworker.0 00000100:00100000:0.0:1789545743.938210:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876474454941440:0@lo:400:kworker.0 00000100:00100000:0.0:1789545743.938223:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454941568:0@lo:400:kworker.0 00000100:00100000:0.0:1789545743.938310:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454941184 00000100:00100000:0.0:1789545743.938318:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454941184 00000100:00100000:0.0:1789545743.938408:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1789545743.938417:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3312:x1876474454941184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545743.938465:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3312:x1876474454941184:12345-0@lo:400:kworker.0 Request processed in 49us (5184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545743.938472:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1789545743.938862:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454941184:0@lo:400:kworker.0 00000100:00100000:1.0:1789545743.945786:0:8211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454941824:12345-0@lo:400:kworker.0 Request processed in 10416us (12567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545743.945806:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789545743.946194:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454941824:0@lo:400:kworker.0 00000100:00100000:3.0:1789545743.946549:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454941696:12345-0@lo:400:kworker.0 Request processed in 10960us (13217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545743.946561:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00010000:00010000:3.0:1789545744.190137:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789545744.318335:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789545744.318351:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789545744.320061:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789545744.320084:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789545744.446121:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454941952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789545744.446225:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545744.446341:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454941952 00000100:00100000:3.0:1789545744.446351:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454941952 00000100:00100000:3.0:1789545744.446427:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789545744.446438:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454941952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789545744.446487:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789545744.446544:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454941952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545744.446561:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789545744.446621:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454941952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789545744.447396:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454942080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789545744.447458:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545744.447602:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454942080 00000100:00100000:1.0:1789545744.447609:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454942080 00000100:00100000:1.0:1789545744.447662:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789545744.447671:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454942080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789545744.447707:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789545744.447759:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454942080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545744.447767:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789545744.447986:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454942080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789545744.818006:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545744.818253:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545744.818298:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545744.818319:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545744.818353:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545744.818420:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438154880 00000100:00100000:2.0:1789545744.818435:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438154880 00000100:00100000:2.0:1789545744.818517:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438154752 00000100:00100000:2.0:1789545744.818520:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438154752 00000100:00100000:2.0:1789545744.818548:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 85 00000100:00100000:2.0:1789545744.818559:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+5:2361:x1876474438154880:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545744.818652:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+5:2361:x1876474438154880:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 94us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545744.818660:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 85 00000100:00100000:2.0:1789545744.818690:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 86 00000100:00100000:2.0:1789545744.818698:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+6:2361:x1876474438154752:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545744.818737:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+6:2361:x1876474438154752:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 40us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545744.818743:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 86 00000100:00100000:2.0:1789545744.818766:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438154496 00000100:00100000:2.0:1789545744.818770:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438154496 00000100:00100000:2.0:1789545744.818796:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 294 00000100:00100000:2.0:1789545744.818802:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2361:x1876474438154496:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545744.818826:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2361:x1876474438154496:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 24us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545744.818832:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 294 00000100:00080000:2.0:1789545744.818859:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789545744.818864:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789545744.819464:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438154624 00000100:00100000:0.0:1789545744.819473:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438154624 00000100:00100000:0.0:1789545744.819532:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438155008 00000100:00100000:0.0:1789545744.819535:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438155008 00000100:00100000:0.0:1789545744.819570:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 147 00000100:00100000:0.0:1789545744.819578:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+14:2361:x1876474438154624:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:0.0:1789545744.819630:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+14:2361:x1876474438154624:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 52us (1633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545744.819637:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 147 00000100:00100000:0.0:1789545744.819658:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 148 00000100:00100000:0.0:1789545744.819676:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2361:x1876474438155008:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:0.0:1789545744.819702:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2361:x1876474438155008:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 27us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545744.819708:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 148 00000100:00080000:2.0:1789545744.820070:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789545745.220088:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545745.329181:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545745.329342:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438155136 00000100:00100000:0.0:1789545745.329357:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438155136 00000100:00100000:0.0:1789545745.329466:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 138 00000100:00100000:0.0:1789545745.329489:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+14:11373:x1876474438155136:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:0.0:1789545745.329520:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545745.329546:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c0f5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de55fb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.329644:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0f61 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.329661:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0f61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.329676:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0f61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.329696:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0f68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.329704:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0f68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.329710:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0f68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.330022:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0f61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.330042:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0f61 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.330050:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0f61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.330056:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6600 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545745.330062:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0f61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.330071:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0f61 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.330086:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bcd248b00) 00010000:00010000:0.0:1789545745.330090:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545745.330097:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0f61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.330104:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0f61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.330116:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0f68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.330123:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0f68 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.330130:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0f68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.330143:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6800 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545745.330147:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0f68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.330153:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0f68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.330162:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff994bc4f11e00) 00010000:00010000:0.0:1789545745.330164:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00080000:2.0:1789545745.330165:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789545745.330167:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0f68 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.330173:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0f68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.330215:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c0f5a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55fb expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.330227:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bcd248b00) 00010000:00010000:0.0:1789545745.330230:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545745.330234:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c0f5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55fb expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.330244:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb7c00, rc 0) 00000100:00100000:0.0:1789545745.330343:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+14:11373:x1876474438155136:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 865us (1178us total) trans 0 rc 301/301 00000100:00100000:0.0:1789545745.330353:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 138 00000100:00100000:0.0:1789545745.335901:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545745.336096:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438155392 00000100:00100000:3.0:1789545745.336109:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438155392 00000100:00100000:3.0:1789545745.336189:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 139 00000100:00100000:3.0:1789545745.336202:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+14:11373:x1876474438155392:12345-192.168.201.16@tcp:36:lfs.0 00010000:00010000:3.0:1789545745.336285:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545745.336335:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c08e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de543b expref: 14 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.336382:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bcd248b00) 00010000:00010000:3.0:1789545745.336397:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789545745.336986:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0f6f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.337005:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0f6f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.337042:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0f6f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.337059:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0f76 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.337067:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0f76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.337074:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0f76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545745.340314:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789545745.340344:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0f6f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.342739:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0f6f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.342766:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0f6f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.342774:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217f600 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545745.342780:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0f6f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.342792:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0f6f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.342813:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4f9e100) 00010000:00010000:3.0:1789545745.342816:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545745.342831:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0f6f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.342839:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0f6f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789545745.342870:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aaa56054 reply state 00000000eec87dbb transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0f76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545745.342881:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789545745.343049:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+15:11373:x1876474438155392:12345-192.168.201.16@tcp:36:lfs.0 Request processed in 6844us (7157us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1789545745.343060:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 139 00010000:00010000:3.0:1789545745.354763:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0f76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.354785:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0f76 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.354795:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0f76 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.354803:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217f000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545745.354809:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0f76 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.354817:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0f76 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.355576:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff994bc4f9eb00) 00010000:00010000:3.0:1789545745.355583:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545745.355592:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0f76 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.355685:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0f76 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545745.452019:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545745.452137:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438155520 00000100:00100000:1.0:1789545745.452153:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438155520 00000100:00100000:1.0:1789545745.452235:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 140 00000100:00100000:1.0:1789545745.452248:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+14:11381:x1876474438155520:12345-192.168.201.16@tcp:101:lctl.0 00010000:00010000:1.0:1789545745.452281:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545745.452310:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0f7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5602 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.452427:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0f84 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.452448:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0f84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.452464:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0f84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789545745.452530:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789545745.452535:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789545745.452565:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0f84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.452598:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0f7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5602 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.452627:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0f84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5602 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.452637:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4ffe700) 00010000:00010000:1.0:1789545745.452642:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789545745.452647:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba9600, rc 0) 00000100:00100000:1.0:1789545745.452725:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+15:11381:x1876474438155520:12345-192.168.201.16@tcp:101:lctl.0 Request processed in 479us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545745.452734:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 140 00000100:00100000:0.0:1789545745.525227:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545745.525278:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438155648 00000100:00100000:0.0:1789545745.525292:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438155648 00000100:00100000:0.0:1789545745.525392:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 141 00000100:00100000:0.0:1789545745.525405:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+15:11387:x1876474438155648:12345-192.168.201.16@tcp:101:bash.0 00010000:00010000:0.0:1789545745.525434:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545745.525462:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c0f8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5609 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.525570:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0f92 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.525590:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0f92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.525613:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0f92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.525632:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0f99 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.525640:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0f99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.525647:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0f99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.526677:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0fa0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.526700:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.526730:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789545745.526779:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789545745.526784:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789545745.526809:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.526825:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0f92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.526832:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0f92 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.526839:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0f92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.526847:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6800 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545745.526851:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0f92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.526860:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0f92 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.526874:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4ffe700) 00010000:00010000:0.0:1789545745.526877:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545745.526882:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0f92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.527081:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c0f92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.527115:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0f99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.527123:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0f99 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.527128:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0f99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.527135:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6600 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545745.527139:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0f99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.527145:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0f99 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.527155:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff994bc4f11e00) 00010000:00010000:0.0:1789545745.527158:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545745.527162:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0f99 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.527169:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c0f99 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.527213:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c0f8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5609 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.527228:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0fa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5609 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.527246:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:0.0:1789545745.527249:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789545745.527251:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb7400, rc 0) 00000100:00100000:0.0:1789545745.527345:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+16:11387:x1876474438155648:12345-192.168.201.16@tcp:101:bash.0 Request processed in 1942us (2134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545745.527354:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 141 00000100:00100000:2.0:1789545745.533603:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545745.533658:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438155904 00000100:00100000:1.0:1789545745.533674:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438155904 00000100:00100000:1.0:1789545745.533786:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 142 00000100:00100000:1.0:1789545745.533799:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+16:11387:x1876474438155904:12345-192.168.201.16@tcp:101:bash.0 00010000:00010000:1.0:1789545745.533827:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545745.533850:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0fa7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5610 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.534014:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c0fae lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.534059:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c0fae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.534073:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c0fae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.536188:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0fb5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.536354:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.536392:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789545745.537428:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1789545745.537776:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c0fbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.537793:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c0fbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.537803:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c0fbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.537840:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c0fae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.537847:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c0fae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.537854:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c0fae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.537869:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba9200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545745.537874:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c0fae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.537883:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c0fae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.537896:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:1.0:1789545745.537899:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545745.537904:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c0fae lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.537911:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c0fae lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789545745.537925:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000723355f5 reply state 00000000528d12f5 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545745.537934:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789545745.538141:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c0fa7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5610 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.538157:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c0fbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5610 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.538166:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bc4ffe100) 00010000:00010000:1.0:1789545745.538168:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789545745.538171:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba9000, rc 0) 00000100:00100000:1.0:1789545745.538353:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+19:11387:x1876474438155904:12345-192.168.201.16@tcp:101:bash.0 Request processed in 4556us (4763us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1789545745.538395:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 142 00010000:00010000:2.0:1789545745.546417:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545745.546442:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0fb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545745.546452:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0fb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545745.546459:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba8400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545745.546479:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0fb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545745.546486:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0fb5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545745.546506:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994bc4ffe000) 00010000:00010000:2.0:1789545745.546508:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545745.546513:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0fb5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545745.546518:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c0fb5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545745.556593:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545745.556794:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438156032 00000100:00100000:3.0:1789545745.556813:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438156032 00000100:00100000:3.0:1789545745.556903:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 47 00000100:00100000:3.0:1789545745.556920:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+5:2361:x1876474438156032:12345-192.168.201.16@tcp:101:bash.0 00010000:00010000:3.0:1789545745.556945:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545745.556975:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c0fca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5617 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789545745.557010:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789545745.557052:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=359s v=(0 0) 00010000:00010000:3.0:1789545745.557057:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789545745.557071:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c0fca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5617 expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.557094:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c0fca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5617 expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.557111:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217f000, rc 0) 00000100:00100000:3.0:1789545745.557200:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+6:2361:x1876474438156032:12345-192.168.201.16@tcp:101:bash.0 Request processed in 285us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545745.557207:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 47 00000100:00100000:0.0:1789545745.567590:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545745.567853:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438156160 00000100:00100000:2.0:1789545745.567868:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438156160 00000100:00100000:2.0:1789545745.567948:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 48 00000100:00100000:2.0:1789545745.567960:0:8211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a8edb7a-f384-4468-93f4-9d664f284862+6:11387:x1876474438156160:12345-192.168.201.16@tcp:101:bash.0 00010000:00010000:2.0:1789545745.567987:0:8211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545745.568014:0:8211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c0fd1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de561e expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545745.568070:0:8211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c0fca lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5617 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545745.568081:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545745.568086:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545745.568092:0:8211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c0fd1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de561e expref: 7 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545745.568155:0:8211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c0fca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5617 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545745.568172:0:8211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c0fca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5617 expref: 7 pid: 6691 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545745.568189:0:8211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be76cb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8211:1876474454942208:192.168.201.16@tcp:104: 00000100:00100000:2.0:1789545745.568315:0:8211:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc8259cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789545745.570635:0:8211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be76cb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8211:1876474454942208:192.168.201.16@tcp:104: 00010000:00010000:2.0:1789545745.570680:0:8211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c0fd1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de561e expref: 7 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545745.570701:0:8211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1200, rc 0) 00000100:00100000:2.0:1789545745.570785:0:8211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a8edb7a-f384-4468-93f4-9d664f284862+7:11387:x1876474438156160:12345-192.168.201.16@tcp:101:bash.0 Request processed in 2827us (3209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545745.570795:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 48 00000100:00100000:1.0:1789545745.575615:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545745.575724:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438156288 00000100:00100000:3.0:1789545745.575757:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438156288 00010000:00010000:3.0:1789545745.575813:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c0fca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5617 expref: 7 pid: 6691 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545745.575875:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 62 00000100:00100000:3.0:1789545745.575887:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+7:2358:x1876474438156288:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789545745.575907:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545745.575949:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c0fca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5617 expref: 7 pid: 6691 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.575967:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c0fca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5617 expref: 7 pid: 6691 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.575998:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c0fca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5617 expref: 7 pid: 6691 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.576031:0:7637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789545745.576036:0:7637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789545745.576046:0:7637:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c0fd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de561e expref: 6 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.576058:0:7637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c0fd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de561e expref: 6 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.576113:0:7637:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c0fd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de561e expref: 6 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545745.576145:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfc50380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7637:1876474454942336:192.168.201.16@tcp:105: 00000100:00100000:3.0:1789545745.576263:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc591f840 going to sleep for 11 seconds 00000100:00100000:0.0:1789545745.582763:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545745.583041:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438156544 00000100:00100000:1.0:1789545745.583056:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438156544 00000100:00100000:1.0:1789545745.583137:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 36 00000100:00100000:1.0:1789545745.583150:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+18:11387:x1876474438156544:12345-192.168.201.16@tcp:35:bash.0 00000100:00100000:1.0:1789545745.583807:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+19:11387:x1876474438156544:12345-192.168.201.16@tcp:35:bash.0 Request processed in 656us (1054us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1789545745.583818:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 36 00000100:00100000:3.0:1789545745.584304:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfc50380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7637:1876474454942336:192.168.201.16@tcp:105: 00010000:00010000:3.0:1789545745.584343:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545745.584413:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+6:2358:x1876474438156288:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 8527us (8825us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545745.584424:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 62 00000100:00100000:0.0:1789545745.700115:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545745.701213:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438156800 00000100:00100000:2.0:1789545745.701231:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438156800 00000100:00100000:2.0:1789545745.701313:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 143 00000100:00100000:2.0:1789545745.701327:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+19:11397:x1876474438156800:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:2.0:1789545745.701388:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545745.701418:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c0fd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5625 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545745.701792:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789545745.702258:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c0fd8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5625 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545745.702276:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4ffe700) 00010000:00010000:2.0:1789545745.702280:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789545745.702287:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c0fd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5625 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545745.702307:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1c00, rc 0) 00000100:00100000:2.0:1789545745.702667:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+20:11397:x1876474438156800:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 1342us (2565us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1789545745.702676:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 143 00000100:00100000:1.0:1789545745.711504:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545745.711647:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438157056 00000100:00100000:3.0:1789545745.711661:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438157056 00000100:00100000:3.0:1789545745.711742:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 37 00000100:00100000:3.0:1789545745.711754:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+20:11397:x1876474438157056:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:3.0:1789545745.712118:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+21:11397:x1876474438157056:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 364us (628us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1789545745.712128:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 37 00000100:00100000:3.0:1789545745.791535:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545745.791765:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438157184 00000100:00100000:0.0:1789545745.791781:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438157184 00000100:00100000:0.0:1789545745.791877:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 144 00000100:00100000:0.0:1789545745.791891:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+21:11403:x1876474438157184:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:0.0:1789545745.791928:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545745.791958:0:10125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0fe6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de562c expref: -99 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.792067:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0fed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.792084:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0fed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.792099:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0fed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789545745.792148:0:10125:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789545745.792169:0:10125:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789545745.792194:0:10125:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0fed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.792227:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c0fe6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de562c expref: 23 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.792250:0:10125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0fed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de562c expref: 22 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.792259:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:0.0:1789545745.792262:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789545745.792267:0:10125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb6400, rc 0) 00000100:00100000:0.0:1789545745.792345:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+22:11403:x1876474438157184:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 457us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545745.792353:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 144 00000100:00100000:0.0:1789545745.805051:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545745.807346:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438157440 00000100:00100000:3.0:1789545745.807431:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438157440 00000100:00100000:3.0:1789545745.807796:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 145 00000100:00100000:3.0:1789545745.807812:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+22:11403:x1876474438157440:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:3.0:1789545745.807854:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545745.807885:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0ff4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5633 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.808052:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ffb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.808092:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.808108:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545745.808126:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789545745.808308:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c0ff4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5633 expref: 25 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.808334:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ffb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5633 expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.808343:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bc4ffe100) 00010000:00010000:3.0:1789545745.808346:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789545745.808351:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217f600, rc 0) 00000100:00100000:3.0:1789545745.808499:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+24:11403:x1876474438157440:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 680us (3453us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1789545745.808510:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 145 00000100:00100000:1.0:1789545745.815121:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545745.815212:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545745.815290:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438157824 00000100:00100000:2.0:1789545745.815304:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438157824 00000100:00100000:2.0:1789545745.815403:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10 00000100:00100000:2.0:1789545745.815416:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a8edb7a-f384-4468-93f4-9d664f284862+24:2360:x1876474438157824:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789545745.815435:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545745.815467:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c0ffb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5633 expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545745.815505:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bc4ffe100) 00010000:00010000:2.0:1789545745.815512:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789545745.815584:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a8edb7a-f384-4468-93f4-9d664f284862+23:2360:x1876474438157824:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 171us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545745.815621:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10 00000100:00100000:0.0:1789545745.818346:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438157696 00000100:00100000:0.0:1789545745.818406:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438157696 00000100:00100000:1.0:1789545745.821212:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 146 00000100:00100000:1.0:1789545745.821231:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+23:11403:x1876474438157696:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:1.0:1789545745.821270:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545745.821304:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1009 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de563a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.821497:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1010 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.821517:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1010 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.821535:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1010 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789545745.821578:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789545745.821792:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1009 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de563a expref: 26 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.821815:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1010 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de563a expref: 25 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.821905:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bc4ffe100) 00010000:00010000:1.0:1789545745.821908:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789545745.821913:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba8200, rc 0) 00000100:00100000:1.0:1789545745.822012:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+25:11403:x1876474438157696:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 785us (6906us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1789545745.822031:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 146 00000100:00100000:1.0:1789545745.827337:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545745.827531:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438157952 00000100:00100000:3.0:1789545745.827544:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438157952 00000100:00100000:3.0:1789545745.827868:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 49 00000100:00100000:3.0:1789545745.827881:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bffcdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+6:2359:x1876474438157952:12345-192.168.201.16@tcp:1:lfs.0 00010000:00010000:3.0:1789545745.827945:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c101e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.827969:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c0fd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de561e expref: 6 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.827997:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789545745.828043:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789545745.828050:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c101e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.828097:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c0fd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de561e expref: 6 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.828113:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c0fd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de561e expref: 6 pid: 8211 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545745.828131:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfc50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876474454942464:192.168.201.16@tcp:104: 00000100:00100000:3.0:1789545745.828277:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc591f840 going to sleep for 11 seconds 00000100:00100000:2.0:1789545745.838990:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfc50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876474454942464:192.168.201.16@tcp:104: 00010000:00010000:2.0:1789545745.839060:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c101e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545745.839629:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545745.839737:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438158080 00000100:00100000:0.0:1789545745.839749:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438158080 00002000:00100000:0.0:1789545745.839832:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff994bffcda300 x1876474438158080/t0(0) o4->8a8edb7a-f384-4468-93f4-9d664f284862@192.168.201.16@tcp:211/0 lens 504/0 e 0 to 0 dl 1789545756 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789545745.839844:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994bffcda300 with x1876474438158080 ext(0->12) 00010000:00010000:0.0:1789545745.839853:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c0fd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de561e expref: 7 pid: 8211 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.839869:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c0fd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de561e expref: 7 pid: 8211 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789545745.839896:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff994bffcda300 00000100:00100000:0.0:1789545745.839943:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2 00000100:00100000:0.0:1789545745.839955:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bffcda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8a8edb7a-f384-4468-93f4-9d664f284862+7:2359:x1876474438158080:12345-192.168.201.16@tcp:4:lfs.0 00000100:00100000:0.0:1789545745.840711:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bffcda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8a8edb7a-f384-4468-93f4-9d664f284862+9:2359:x1876474438158080:12345-192.168.201.16@tcp:4:lfs.0 Request processed in 753us (1079us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789545745.840722:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2 00002000:00100000:0.0:1789545745.840731:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff994bffcda300 x1876474438158080/t4294967305(0) o4->8a8edb7a-f384-4468-93f4-9d664f284862@192.168.201.16@tcp:211/0 lens 504/448 e 0 to 0 dl 1789545756 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789545745.840741:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994bffcda300 with x1876474438158080 ext(0->12) 00010000:00010000:0.0:1789545745.840749:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c0fd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de561e expref: 9 pid: 8211 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545745.840765:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c0fd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de561e expref: 9 pid: 8211 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789545745.840773:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff994bffcda300 00000100:00100000:3.0:1789545745.844858:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545745.847703:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438158208 00000100:00100000:2.0:1789545745.847727:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438158208 00010000:00010000:2.0:1789545745.847799:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c0fd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de561e expref: 9 pid: 8211 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545745.847943:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 63 00000100:00100000:2.0:1789545745.847956:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+9:2361:x1876474438158208:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789545745.847977:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789545745.848453:0:5833:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789545745.848457:0:5833:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789545745 00002000:00010000:2.0:1789545745.848460:0:5833:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789545746 00002000:00010000:2.0:1789545745.848463:0:5833:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789545745 00010000:00010000:2.0:1789545745.848473:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c0fd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de561e expref: 9 pid: 8211 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545745.848493:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c0fd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de561e expref: 9 pid: 8211 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545745.848526:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c0fd1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de561e expref: 9 pid: 8211 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545745.848576:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789545745.848581:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789545745.848587:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c101e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545745.848891:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c101e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545745.849032:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789545745.849130:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+8:2361:x1876474438158208:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1174us (4286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545745.849140:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 63 00010000:00010000:3.0:1789545745.851758:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c101e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.851787:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c101e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.852208:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c101e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.852230:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c101e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.852269:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c101e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.852278:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217f000 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545745.852283:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c101e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.852296:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c101e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.852320:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c101e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545745.852328:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000406e342/0x64919c0f856c101e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545745.852562:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bffcdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+7:2359:x1876474438157952:12345-192.168.201.16@tcp:1:lfs.0 Request processed in 24676us (25234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545745.852574:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 49 00000100:00100000:3.0:1789545745.856464:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545745.856616:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438158464 00000100:00100000:0.0:1789545745.856630:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438158464 00000100:00100000:0.0:1789545745.856711:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 38 00000100:00100000:0.0:1789545745.856723:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+25:11403:x1876474438158464:12345-192.168.201.16@tcp:35:lfs.0 00000004:00010000:0.0:1789545745.856883:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1010 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de563a expref: 25 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789545745.857317:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1789545745.858113:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1789545745.860187:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1789545745.860320:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1025 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.860350:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c0fbc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5610 expref: 29 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.860439:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1025 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.860614:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c0fbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5610 expref: 29 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.860652:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c0fbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5610 expref: 29 pid: 5848 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545745.860675:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bffcdb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1876474454942592:192.168.201.16@tcp:104: 00000100:00100000:1.0:1789545745.860907:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc4a63a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789545745.865281:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bffcdb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1876474454942592:192.168.201.16@tcp:104: 00010000:00010000:1.0:1789545745.865325:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1025 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545745.869043:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545745.869298:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438158592 00000100:00100000:2.0:1789545745.869312:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438158592 00010000:00010000:2.0:1789545745.869499:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c0fbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5610 expref: 30 pid: 5848 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545745.869594:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 64 00000100:00100000:2.0:1789545745.869618:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+30:2358:x1876474438158592:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789545745.869640:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545745.869648:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c0fbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5610 expref: 30 pid: 5848 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545745.869663:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c0fbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5610 expref: 30 pid: 5848 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545745.869715:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c0fbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5610 expref: 30 pid: 5848 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545745.869737:0:7637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bc4ffe100) 00010000:00010000:2.0:1789545745.869743:0:7637:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1025 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545745.869755:0:7637:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1025 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545745.869764:0:7637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1025 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545745.869804:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789545745.869845:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1025 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.869854:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1025 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545745.869894:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+29:2358:x1876474438158592:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 279us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545745.869902:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 64 00000001:00080000:1.0:1789545745.870611:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1789545745.870883:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1789545745.871031:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bffcdb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1876474454942720:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789545745.871135:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545745.871182:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdf4659c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789545745.871390:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454942720 00000100:00100000:3.0:1789545745.871399:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454942720 00000100:00100000:3.0:1789545745.872647:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789545745.872670:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1876474454942720:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789545745.872817:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1876474454942720:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 158us (1682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545745.872825:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1789545745.873345:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789545745.873412:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bffcdb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1876474454942720:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789545745.874011:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1789545745.874133:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be3a9f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1876474454942848:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789545745.874188:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545745.874243:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc7c24cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789545745.874399:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454942848 00000100:00100000:2.0:1789545745.874409:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454942848 00000100:00100000:2.0:1789545745.874465:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789545745.874475:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1876474454942848:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789545745.874725:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5849:x1876474454942848:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 251us (534us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789545745.874734:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789545745.877176:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be3a9f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1876474454942848:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789545745.877336:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1789545745.877451:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1025 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.877465:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1025 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.877475:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1025 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.877484:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba9800 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545745.877490:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1025 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.877499:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1025 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.877519:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bc4ffe100) 00010000:00010000:1.0:1789545745.877523:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789545745.877529:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1025 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545745.877536:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1025 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789545745.877816:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789545745.877948:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1789545745.877959:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 359800599183ns, next at 360800596486ns, rc = 0 00000001:00080000:1.0:1789545745.877966:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1789545745.878008:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bc4ffe100) 00010000:00010000:1.0:1789545745.878102:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789545745.878112:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1010 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de563a expref: 33 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545745.879712:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+32:11403:x1876474438158464:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 22977us (23249us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1789545745.879728:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 38 00000020:00080000:1.0:1789545745.879739:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789545745.884674:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545745.884880:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438158720 00000100:00100000:2.0:1789545745.884894:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438158720 00000100:00100000:2.0:1789545745.888477:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 147 00000100:00100000:2.0:1789545745.888576:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+32:11403:x1876474438158720:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:2.0:1789545745.888905:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545745.888937:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c102c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5641 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545745.890369:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c102c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5641 expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545745.890404:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c102c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5641 expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545745.890443:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248d00) 00010000:00010000:2.0:1789545745.890448:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789545745.890453:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1c00, rc 0) 00000100:00100000:2.0:1789545745.890568:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+33:11403:x1876474438158720:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 2002us (5908us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545745.895333:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545745.896169:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438158976 00000100:00100000:3.0:1789545745.896186:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438158976 00000100:00100000:3.0:1789545745.896701:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 39 00000100:00100000:3.0:1789545745.896718:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+34:11403:x1876474438158976:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:3.0:1789545745.897275:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+35:11403:x1876474438158976:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 505us (1902us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1789545745.897288:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 39 00000100:00100000:2.0:1789545745.900248:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 147 00000100:00100000:0.0:1789545746.019205:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545746.019341:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438159232 00000100:00100000:1.0:1789545746.019356:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438159232 00000100:00100000:1.0:1789545746.019465:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 148 00000100:00100000:1.0:1789545746.019477:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+34:11413:x1876474438159232:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:1.0:1789545746.019510:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545746.019536:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1033 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5648 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789545746.019676:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789545746.020030:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1033 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5648 expref: 36 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.020049:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4ffe700) 00010000:00010000:1.0:1789545746.020052:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789545746.020059:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1033 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5648 expref: 36 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.020077:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba8200, rc 0) 00000100:00100000:1.0:1789545746.020195:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+35:11413:x1876474438159232:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 720us (1004us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1789545746.020223:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 148 00000100:00100000:0.0:1789545746.030125:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545746.030530:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438159360 00000100:00100000:2.0:1789545746.030545:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438159360 00000100:00100000:2.0:1789545746.030626:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 149 00000100:00100000:2.0:1789545746.030637:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+35:11413:x1876474438159360:12345-192.168.201.16@tcp:34:lfs.0 00010000:00010000:2.0:1789545746.030741:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1000/0x64919c0f856c1041 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.030763:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1000/0x64919c0f856c1041 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.030777:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1000/0x64919c0f856c1041 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.030816:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1048 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.030823:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1048 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.030829:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1048 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.030948:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c104f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.030956:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c104f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.030963:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c104f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789545746.031025:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c104f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.031041:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1000/0x64919c0f856c1041 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.031047:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1000/0x64919c0f856c1041 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.031054:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1000/0x64919c0f856c1041 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.031061:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545746.031066:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1000/0x64919c0f856c1041 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.031082:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1000/0x64919c0f856c1041 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.031579:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:2.0:1789545746.031584:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545746.031592:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1000/0x64919c0f856c1041 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.031600:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1000/0x64919c0f856c1041 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.031617:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1048 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.031623:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1048 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.031629:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1048 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.031634:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1e00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545746.031637:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1048 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.031643:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1048 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.031650:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994bcd248e00) 00010000:00010000:2.0:1789545746.031652:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545746.031655:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1048 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.031673:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1048 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.031693:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c104f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.031698:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c104f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.031704:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c104f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.031708:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545746.031711:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c104f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.031717:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c104f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.031724:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248d00) 00010000:00010000:2.0:1789545746.031726:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545746.031728:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c104f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.031733:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c104f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545746.031862:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+35:11413:x1876474438159360:12345-192.168.201.16@tcp:34:lfs.0 Request processed in 1222us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545746.031872:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 149 00000100:00100000:1.0:1789545746.039222:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545746.039328:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438159616 00000100:00100000:2.0:1789545746.039341:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438159616 00000100:00100000:2.0:1789545746.039455:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 40 00000100:00100000:2.0:1789545746.039467:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+35:11413:x1876474438159616:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:2.0:1789545746.039803:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+36:11413:x1876474438159616:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 336us (594us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1789545746.039812:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 40 00000100:00100000:3.0:1789545746.091000:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545746.096771:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438159872 00000100:00100000:0.0:1789545746.096798:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438159872 00000100:00100000:1.0:1789545746.097033:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 150 00000100:00100000:1.0:1789545746.097047:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+36:11416:x1876474438159872:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:1.0:1789545746.097081:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545746.097122:0:10125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1056 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de564f expref: -99 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.097228:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c105d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.097247:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c105d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.097264:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c105d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.097282:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1064 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.097291:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1064 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.097299:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1064 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.097520:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c106b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.097531:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c106b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.097559:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c106b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789545746.097573:0:10125:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789545746.097705:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c105d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.097715:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c105d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.097723:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c105d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.097729:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba9c00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545746.097734:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c105d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.097744:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c105d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.097759:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:1.0:1789545746.097763:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545746.097769:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c105d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.097777:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c105d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.097793:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1064 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.097800:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1064 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.097813:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1064 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.097819:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba9200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545746.097821:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1064 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.097828:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1064 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.097835:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994bc4ffe100) 00010000:00010000:1.0:1789545746.097838:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545746.097841:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1064 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.097848:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1064 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.097904:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1056 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de564f expref: 39 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.097921:0:10125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c106b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de564f expref: 38 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.097930:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248d00) 00010000:00010000:1.0:1789545746.097932:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789545746.097935:0:10125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba8800, rc 0) 00000100:00100000:1.0:1789545746.098035:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+38:11416:x1876474438159872:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 990us (7050us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1789545746.098054:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 150 00000100:00100000:0.0:1789545746.104803:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545746.104926:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438160000 00000100:00100000:2.0:1789545746.104939:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438160000 00000100:00100000:2.0:1789545746.105027:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 151 00000100:00100000:2.0:1789545746.105041:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+38:11416:x1876474438160000:12345-192.168.201.16@tcp:54:lfs.0 00010000:00010000:2.0:1789545746.105140:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1079 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.105163:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.105178:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.105211:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.105220:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1079 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.105227:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1079 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.105234:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545746.105257:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1079 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.105267:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1079 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.105283:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248d00) 00010000:00010000:2.0:1789545746.105287:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789545746.105293:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1079 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.105301:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1079 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545746.105452:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+38:11416:x1876474438160000:12345-192.168.201.16@tcp:54:lfs.0 Request processed in 413us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545746.105461:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 151 00000100:00100000:3.0:1789545746.108035:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545746.108201:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438160256 00000100:00100000:2.0:1789545746.108215:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438160256 00000100:00100000:2.0:1789545746.108298:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 41 00000100:00100000:2.0:1789545746.108311:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+38:11416:x1876474438160256:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:2.0:1789545746.108675:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+39:11416:x1876474438160256:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 366us (661us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1789545746.108684:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 41 00010000:00010000:2.0:1789545746.237612:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789545746.365136:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789545746.365148:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789545746.365489:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1789545746.365500:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789545746.394134:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545746.394294:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438160512 00000100:00100000:1.0:1789545746.394309:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438160512 00000100:00100000:1.0:1789545746.394425:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 152 00000100:00100000:1.0:1789545746.394439:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+39:11447:x1876474438160512:12345-192.168.201.16@tcp:101:cat.0 00010000:00010000:1.0:1789545746.394472:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545746.394697:0:10125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1080 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5656 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.395065:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1087 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.395085:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.395099:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789545746.395112:0:10125:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789545746.395280:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1080 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5656 expref: 42 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.395302:0:10125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1087 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5656 expref: 41 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.395312:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248d00) 00010000:00010000:1.0:1789545746.395316:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789545746.395320:0:10125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba9200, rc 0) 00000100:00100000:1.0:1789545746.395478:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+41:11447:x1876474438160512:12345-192.168.201.16@tcp:101:cat.0 Request processed in 1041us (1358us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1789545746.396701:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 152 00000100:00100000:1.0:1789545746.400822:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545746.400999:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438160768 00000100:00100000:3.0:1789545746.401021:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438160768 00000100:00100000:3.0:1789545746.401092:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 42 00000100:00100000:3.0:1789545746.401103:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+41:11447:x1876474438160768:12345-192.168.201.16@tcp:35:cat.0 00000100:00100000:3.0:1789545746.401509:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+42:11447:x1876474438160768:12345-192.168.201.16@tcp:35:cat.0 Request processed in 406us (707us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1789545746.401517:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 42 00000100:00100000:0.0:1789545746.406509:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545746.406666:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438160896 00000100:00100000:1.0:1789545746.406680:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438160896 00000100:00100000:1.0:1789545746.406773:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11 00000100:00100000:1.0:1789545746.406786:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd9366450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a8edb7a-f384-4468-93f4-9d664f284862+42:2358:x1876474438160896:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789545746.406804:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545746.406847:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1087 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5656 expref: 42 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.406870:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248d00) 00010000:00010000:1.0:1789545746.406877:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789545746.406958:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd9366450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a8edb7a-f384-4468-93f4-9d664f284862+41:2358:x1876474438160896:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 173us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545746.406966:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11 00000100:00100000:3.0:1789545746.475676:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545746.476688:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438161152 00000100:00100000:2.0:1789545746.476707:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438161152 00000100:00100000:2.0:1789545746.476806:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 153 00000100:00100000:2.0:1789545746.476820:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+41:11453:x1876474438161152:12345-192.168.201.16@tcp:101:dd.0 00010000:00010000:2.0:1789545746.476878:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545746.476882:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789545746.476921:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c0fed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de562c expref: 41 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.476947:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:2.0:1789545746.476953:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789545746.476971:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1095 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de565d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.477135:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c109c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.477151:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c106b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de564f expref: 41 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.477161:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c109c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.477205:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c106b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de564f expref: 41 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.477221:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c106b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de564f expref: 41 pid: 10125 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545746.477237:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be76cb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876474454942976:192.168.201.16@tcp:104: 00000100:00100000:2.0:1789545746.477594:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc8259240 going to sleep for 11 seconds 00000100:00100000:2.0:1789545746.485574:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be76cb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876474454942976:192.168.201.16@tcp:104: 00010000:00010000:2.0:1789545746.485637:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c109c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545746.485844:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545746.486495:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438161280 00000100:00100000:2.0:1789545746.486508:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438161280 00010000:00010000:2.0:1789545746.486562:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c106b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de564f expref: 42 pid: 10125 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545746.486609:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 65 00000100:00100000:2.0:1789545746.486620:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a8edb7a-f384-4468-93f4-9d664f284862+42:2359:x1876474438161280:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789545746.486638:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545746.486646:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c106b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de564f expref: 42 pid: 10125 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.486662:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c106b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de564f expref: 42 pid: 10125 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.486689:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c106b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de564f expref: 42 pid: 10125 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.486712:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248d00) 00010000:00010000:2.0:1789545746.486717:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c109c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.486729:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c109c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.486738:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c109c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.486789:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789545746.486931:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a8edb7a-f384-4468-93f4-9d664f284862+41:2359:x1876474438161280:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 312us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545746.486941:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 65 00010000:00010000:3.0:1789545746.486948:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c109c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545746.486957:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c109c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545746.486988:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789545746.487325:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1095 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de565d expref: 42 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545746.487346:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c109c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de565d expref: 41 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545746.487355:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248d00) 00010000:00010000:3.0:1789545746.487405:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789545746.487408:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1e00, rc 0) 00000100:00100000:3.0:1789545746.487444:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+41:11453:x1876474438161152:12345-192.168.201.16@tcp:101:dd.0 Request processed in 10628us (11784us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1789545746.487452:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 153 00000100:00100000:0.0:1789545746.509122:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545746.512992:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438161536 00000100:00100000:2.0:1789545746.513025:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438161536 00000100:00100000:2.0:1789545746.513110:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 154 00000100:00100000:2.0:1789545746.513123:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+41:11453:x1876474438161536:12345-192.168.201.16@tcp:36:dd.0 00010000:00010000:2.0:1789545746.513608:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1000/0x64919c0f856c10aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.513631:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1000/0x64919c0f856c10aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.513645:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1000/0x64919c0f856c10aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789545746.513707:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1789545746.513737:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c478fcc2 reply state 000000006a37b65e transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1000/0x64919c0f856c10aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545746.513746:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789545746.513890:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+44:11453:x1876474438161536:12345-192.168.201.16@tcp:36:dd.0 Request processed in 767us (4776us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1789545746.513899:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 154 00000020:00080000:2.0:1789545746.513906:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789545746.529860:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1000/0x64919c0f856c10aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545746.529885:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1000/0x64919c0f856c10aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545746.529895:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1000/0x64919c0f856c10aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545746.529902:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545746.529909:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1000/0x64919c0f856c10aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545746.529919:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1000/0x64919c0f856c10aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545746.529959:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248d00) 00010000:00010000:3.0:1789545746.529962:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545746.529969:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1000/0x64919c0f856c10aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545746.529976:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1000/0x64919c0f856c10aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789545746.566016:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967426 is committed 00000001:00080000:3.0:1789545746.566046:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967437 is committed 00000004:00080000:3.0:1789545746.566059:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1789545746.566094:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff994bdf465d80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1789545746.566100:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994bdfc47e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff994bdf4659c0 00000020:00080000:3.0:1789545746.566104:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994be43e6300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff994bdf5d6800 00000001:00080000:3.0:1789545746.566142:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967439 is committed 00000020:00080000:3.0:1789545746.566166:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1789545746.566403:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1789545746.566890:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789545746.567263:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be3a9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454943104:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789545746.567450:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545746.567770:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454943104 00000100:00100000:2.0:1789545746.567781:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454943104 00000100:00100000:2.0:1789545746.567958:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789545746.567988:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1876474454943104:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789545746.568036:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1789545746.568081:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aaa4d11, atime: 0x6aaa4d12, ctime: 0x6aaa4d11, blocks: 0x1 00010000:00010000:2.0:1789545746.568091:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031b6c5ca/0x64919c0f856c10b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.568111:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=360s v=(0 0) 00010000:00010000:2.0:1789545746.568116:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545746.568123:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031b6c5ca/0x64919c0f856c10b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.568142:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031b6c5ca/0x64919c0f856c10b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.568153:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031b6c5ca/0x64919c0f856c10b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.568161:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031b6c5ca/0x64919c0f856c10b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.568186:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789545746.568692:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789545746.568701:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031b6c5ca/0x64919c0f856c10b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545746.568711:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0000 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545746.568717:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031b6c5ca/0x64919c0f856c10b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545746.568728:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031b6c5ca/0x64919c0f856c10b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545746.568762:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031b6c5ca/0x64919c0f856c10b1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545746.568770:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031b6c5ca/0x64919c0f856c10b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545746.568794:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545746.568796:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545746.568797:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545746.569229:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1876474454943104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1241us (1776us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789545746.569238:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:0.0:1789545746.569438:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff994be3a9d880/2, rc 0, transno 4294967307 00000100:00100000:0.0:1789545746.569446:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be3a9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454943104:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789545746.818175:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545746.818354:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438161664 00000100:00100000:3.0:1789545746.818412:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438161664 00000100:00100000:3.0:1789545746.818499:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 155 00000100:00100000:3.0:1789545746.818512:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+18:11467:x1876474438161664:12345-192.168.201.16@tcp:101:stat.0 00010000:00010000:3.0:1789545746.818548:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545746.818575:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c10b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5664 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545746.818682:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c10bf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545746.818701:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c10bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545746.818716:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c10bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545746.818733:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c10c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545746.818758:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c10c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545746.818766:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c10c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545746.819267:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c10cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545746.819284:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c109c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de565d expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545746.819294:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c10cd lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545746.819340:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c109c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de565d expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545746.819396:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c109c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de565d expref: 19 pid: 5847 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545746.819414:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994becd93b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876474454943232:192.168.201.16@tcp:104: 00000100:00100000:3.0:1789545746.819553:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc66223c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789545746.821888:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994becd93b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876474454943232:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545746.821929:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c10cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545746.825306:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545746.825576:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438161920 00000100:00100000:3.0:1789545746.825611:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438161920 00000100:00100000:3.0:1789545746.825707:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 43 00000100:00100000:3.0:1789545746.825719:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+20:5594:x1876474438161920:12345-192.168.201.16@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789545746.826185:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+21:5594:x1876474438161920:12345-192.168.201.16@tcp:35:ldlm_bl.0 Request processed in 467us (893us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1789545746.826196:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 43 00000100:00100000:3.0:1789545746.830221:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545746.830428:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438162048 00000100:00100000:2.0:1789545746.830443:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438162048 00010000:00010000:2.0:1789545746.830501:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c109c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de565d expref: 21 pid: 5847 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545746.830575:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 66 00000100:00100000:2.0:1789545746.830599:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+21:2358:x1876474438162048:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789545746.830619:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545746.830638:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c109c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de565d expref: 21 pid: 5847 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.830654:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c109c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de565d expref: 21 pid: 5847 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.830686:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c109c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de565d expref: 21 pid: 5847 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.830709:0:7637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248d00) 00010000:00010000:2.0:1789545746.830716:0:7637:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c10cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.830727:0:7637:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c10cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.830736:0:7637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c10cd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.830779:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789545746.830867:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+20:2358:x1876474438162048:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 271us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545746.830877:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 66 00010000:00010000:0.0:1789545746.831629:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c10cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545746.831644:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c10cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789545746.831711:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789545746.831716:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789545746.831746:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c10cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545746.831779:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c10cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545746.831792:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c10bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545746.831812:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c10bf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545746.831822:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c10bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545746.831828:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217e400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545746.831833:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c10bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545746.831842:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c10bf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545746.831858:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:0.0:1789545746.831862:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545746.831866:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c10bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545746.831873:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c10bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545746.831894:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c10c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545746.831900:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c10c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545746.831914:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c10c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545746.831919:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217fa00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545746.831923:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c10c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545746.831929:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c10c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545746.831937:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994bc4f9eb00) 00010000:00010000:0.0:1789545746.831940:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545746.831943:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c10c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545746.831949:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c10c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545746.832017:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c10b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5664 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545746.832035:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c10cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5664 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545746.832210:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248d00) 00010000:00010000:0.0:1789545746.832213:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789545746.832217:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217f600, rc 0) 00000100:00100000:0.0:1789545746.832306:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+19:11467:x1876474438161664:12345-192.168.201.16@tcp:101:stat.0 Request processed in 13795us (14146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545746.832326:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 155 00000100:00100000:3.0:1789545746.895745:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545746.895872:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438162304 00000100:00100000:2.0:1789545746.895904:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438162304 00000100:00100000:2.0:1789545746.895984:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 156 00000100:00100000:2.0:1789545746.896006:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+19:11473:x1876474438162304:12345-192.168.201.16@tcp:36:truncate.0 00010000:00010000:2.0:1789545746.896092:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545746.896128:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c10cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5664 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.896155:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248d00) 00010000:00010000:2.0:1789545746.896161:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789545746.896514:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c10d4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.896532:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c10d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545746.896544:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c10d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789545746.896608:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1789545746.896636:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e15fd2d reply state 0000000000b55a0c transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c10d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545746.896645:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789545746.896781:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+21:11473:x1876474438162304:12345-192.168.201.16@tcp:36:truncate.0 Request processed in 785us (1049us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1789545746.896790:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 156 00000020:00080000:2.0:1789545746.896796:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789545746.902302:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c10d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.902326:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c10d4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.902336:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c10d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.902345:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1e00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545746.902350:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c10d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.902428:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c10d4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.902451:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248d00) 00010000:00010000:1.0:1789545746.902455:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545746.902462:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c10d4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545746.902469:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c10d4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545747.081524:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545747.081682:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438162432 00000100:00100000:2.0:1789545747.081696:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438162432 00000100:00100000:2.0:1789545747.081807:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 157 00000100:00100000:2.0:1789545747.081838:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+20:11487:x1876474438162432:12345-192.168.201.16@tcp:101:stat.0 00010000:00010000:2.0:1789545747.081873:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545747.081901:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c10db lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de566b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.081988:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c10e2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.082023:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c10e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789545747.082150:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789545747.082287:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c10e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.082311:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c10e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.082318:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c10e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.082327:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c10e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.082720:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c10f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.082731:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c10f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.082739:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c10f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545747.082799:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1789545747.082804:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789545747.082834:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c10f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.082849:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c10f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.082858:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c10e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.082865:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c10e2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.082873:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c10e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.082879:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545747.082884:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c10e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.082893:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c10e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.082908:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:2.0:1789545747.082911:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545747.082917:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c10e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.082924:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c10e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.082950:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c10e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.082957:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c10e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.082963:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c10e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.082969:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0a00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545747.082972:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c10e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.082978:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c10e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.082987:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994bcd248800) 00010000:00010000:2.0:1789545747.082989:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545747.083004:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c10e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.083010:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c10e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.085333:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c10db lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de566b expref: 22 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.085401:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c10f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de566b expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.085436:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248d00) 00010000:00010000:2.0:1789545747.085439:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789545747.085443:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0c00, rc 0) 00000100:00100000:2.0:1789545747.085546:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+21:11487:x1876474438162432:12345-192.168.201.16@tcp:101:stat.0 Request processed in 3709us (4038us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545747.085557:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 157 00000100:00100000:2.0:1789545747.224929:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545747.225070:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438162688 00000100:00100000:1.0:1789545747.225085:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438162688 00000100:00100000:1.0:1789545747.225178:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 158 00000100:00100000:1.0:1789545747.225193:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+21:11497:x1876474438162688:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:1.0:1789545747.225224:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545747.225252:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c10f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5672 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789545747.225423:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789545747.225599:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c10f7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5672 expref: 23 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545747.225617:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4ffe700) 00010000:00010000:1.0:1789545747.225620:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789545747.225627:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c10f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5672 expref: 23 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545747.225668:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba9c00, rc 0) 00000100:00100000:1.0:1789545747.225747:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+22:11497:x1876474438162688:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 559us (834us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1789545747.225756:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 158 00000100:00100000:0.0:1789545747.239445:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545747.239719:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438162944 00000100:00100000:2.0:1789545747.239734:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438162944 00000100:00100000:2.0:1789545747.239889:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 44 00000100:00100000:2.0:1789545747.239903:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8cc7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+22:11497:x1876474438162944:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:2.0:1789545747.240278:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8cc7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+23:11497:x1876474438162944:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 377us (846us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1789545747.240287:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 44 00010000:00010000:2.0:1789545747.260805:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789545747.355149:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545747.355444:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438163200 00000100:00100000:0.0:1789545747.355462:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438163200 00000100:00100000:0.0:1789545747.355543:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 159 00000100:00100000:0.0:1789545747.355557:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+23:11503:x1876474438163200:12345-192.168.201.16@tcp:101:bash.0 00010000:00010000:0.0:1789545747.355603:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545747.355631:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c1105 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5679 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.355767:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c110c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.355785:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c10f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de566b expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.355795:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c110c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.355840:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c10f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de566b expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.355856:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c10f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de566b expref: 24 pid: 5847 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545747.355874:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876474454943360:192.168.201.16@tcp:104: 00000100:00100000:0.0:1789545747.356010:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8db1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789545747.360184:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545747.360477:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876474454943360:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545747.360513:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c110c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545747.363353:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438163328 00000100:00100000:2.0:1789545747.363392:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438163328 00010000:00010000:2.0:1789545747.363468:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c10f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de566b expref: 25 pid: 5847 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545747.363534:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 67 00000100:00100000:2.0:1789545747.363547:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+25:2358:x1876474438163328:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789545747.363567:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545747.363576:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c10f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de566b expref: 25 pid: 5847 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.363617:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c10f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de566b expref: 25 pid: 5847 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.363649:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c10f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de566b expref: 25 pid: 5847 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.363670:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248d00) 00010000:00010000:2.0:1789545747.363676:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c110c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.363686:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c110c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.363695:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c110c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.363737:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789545747.363944:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c110c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.363953:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c110c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545747.363979:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000100:00100000:2.0:1789545747.364285:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+25:2358:x1876474438163328:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 738us (4112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545747.364296:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 67 00010000:00010000:3.0:1789545747.366281:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c1105 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5679 expref: 25 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.366319:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c110c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5679 expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.366329:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248d00) 00010000:00010000:3.0:1789545747.366356:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789545747.366382:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb7000, rc 0) 00000100:00100000:3.0:1789545747.366485:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+24:11503:x1876474438163200:12345-192.168.201.16@tcp:101:bash.0 Request processed in 10929us (11351us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1789545747.366496:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 159 00000100:00100000:2.0:1789545747.372831:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545747.372905:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438163584 00000100:00100000:1.0:1789545747.372918:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438163584 00000100:00100000:1.0:1789545747.372977:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 160 00000100:00100000:1.0:1789545747.372998:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+24:11503:x1876474438163584:12345-192.168.201.16@tcp:36:bash.0 00010000:00010000:1.0:1789545747.373405:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c111a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545747.373430:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c111a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545747.373444:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c111a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789545747.373509:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1789545747.373536:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d61e100 reply state 000000002c78863c transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c111a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545747.373545:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789545747.373693:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+27:11503:x1876474438163584:12345-192.168.201.16@tcp:36:bash.0 Request processed in 705us (887us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1789545747.373702:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 160 00000020:00080000:1.0:1789545747.373708:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789545747.378158:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c111a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.378185:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c111a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.378195:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c111a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.378276:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba8400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545747.378283:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c111a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.378293:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c111a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.378316:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248d00) 00010000:00010000:3.0:1789545747.378320:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545747.378327:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c111a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.378334:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c111a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545747.389976:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545747.390193:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438163712 00000100:00100000:3.0:1789545747.390208:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438163712 00000100:00100000:3.0:1789545747.390293:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 161 00000100:00100000:3.0:1789545747.390328:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+26:11503:x1876474438163712:12345-192.168.201.16@tcp:101:bash.0 00010000:00010000:3.0:1789545747.390413:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545747.390439:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c1121 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5680 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.390547:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c1128 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.390565:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c110c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5679 expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.390575:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c1128 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.390618:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c110c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5679 expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.390635:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c110c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5679 expref: 27 pid: 5846 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545747.390651:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876474454943488:192.168.201.16@tcp:104: 00000100:00100000:3.0:1789545747.390751:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc6622480 going to sleep for 11 seconds 00000100:00100000:3.0:1789545747.393623:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876474454943488:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545747.393762:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c1128 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545747.393818:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545747.395788:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438163840 00000100:00100000:0.0:1789545747.395807:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438163840 00010000:00010000:1.0:1789545747.397622:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c110c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5679 expref: 28 pid: 5846 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545747.397797:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 68 00000100:00100000:1.0:1789545747.397810:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a8edb7a-f384-4468-93f4-9d664f284862+28:2359:x1876474438163840:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789545747.397826:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545747.397833:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c110c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5679 expref: 28 pid: 5846 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545747.397846:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c110c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5679 expref: 28 pid: 5846 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545747.397869:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c110c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5679 expref: 28 pid: 5846 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545747.397886:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248d00) 00010000:00010000:1.0:1789545747.397891:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c1128 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545747.397899:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c1128 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545747.397907:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c1128 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545747.397941:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789545747.398071:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a8edb7a-f384-4468-93f4-9d664f284862+27:2359:x1876474438163840:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 264us (4655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545747.398080:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 68 00010000:00010000:3.0:1789545747.398205:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c1128 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.398226:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c1128 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545747.398275:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789545747.398280:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789545747.398304:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c1128 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.398339:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c1121 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5680 expref: 27 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.398401:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c1128 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5680 expref: 26 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.398411:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248d00) 00010000:00010000:3.0:1789545747.398414:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789545747.398416:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217fa00, rc 0) 00000100:00100000:3.0:1789545747.398456:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+26:11503:x1876474438163712:12345-192.168.201.16@tcp:101:bash.0 Request processed in 8132us (8495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545747.398463:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 161 00000100:00100000:1.0:1789545747.410428:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545747.410589:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438164096 00000100:00100000:2.0:1789545747.410603:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438164096 00000100:00100000:2.0:1789545747.410675:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 45 00000100:00100000:2.0:1789545747.410688:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+26:11503:x1876474438164096:12345-192.168.201.16@tcp:35:bash.0 00000100:00100000:2.0:1789545747.411183:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+27:11503:x1876474438164096:12345-192.168.201.16@tcp:35:bash.0 Request processed in 497us (772us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1789545747.411201:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 45 00000100:00100000:1.0:1789545747.550721:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545747.550840:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438164352 00000100:00100000:2.0:1789545747.550858:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438164352 00000100:00100000:2.0:1789545747.550946:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 162 00000100:00100000:2.0:1789545747.550960:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+27:11513:x1876474438164352:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:2.0:1789545747.551003:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545747.551031:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c112f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5687 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545747.551171:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789545747.551355:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c112f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5687 expref: 29 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.551403:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4ffe700) 00010000:00010000:2.0:1789545747.551407:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789545747.551413:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c112f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5687 expref: 29 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.551431:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0c00, rc 0) 00000100:00100000:2.0:1789545747.551510:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+28:11513:x1876474438164352:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 553us (800us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1789545747.551519:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 162 00000100:00100000:1.0:1789545747.560884:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545747.561626:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438164480 00000100:00100000:0.0:1789545747.561641:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438164480 00000100:00100000:0.0:1789545747.561726:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 163 00000100:00100000:0.0:1789545747.561740:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+28:11513:x1876474438164480:12345-192.168.201.16@tcp:34:lfs.0 00010000:00010000:0.0:1789545747.562497:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c113d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.562521:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c113d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.562537:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c113d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.562555:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c1144 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.562819:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c1144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.562830:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c1144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.566046:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c114b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.566204:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c114b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.566220:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c114b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789545747.566305:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c114b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.570418:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c113d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.570441:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c113d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.570451:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c113d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.570458:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb7000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545747.570464:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c113d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.570472:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c113d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.570494:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:0.0:1789545747.570497:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545747.570503:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c113d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.570510:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c113d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.570535:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c1144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.570541:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c1144 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.570572:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c1144 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.570579:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545747.570582:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c1144 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.570588:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c1144 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.570596:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994bc4f11900) 00010000:00010000:0.0:1789545747.570598:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545747.570601:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c1144 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.570606:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c1144 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.570630:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c114b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.570636:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c114b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.570643:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c114b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.570648:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545747.570651:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c114b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.570669:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c114b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.570678:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248d00) 00010000:00010000:0.0:1789545747.570680:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545747.570683:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c114b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.570690:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c114b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545747.571283:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+28:11513:x1876474438164480:12345-192.168.201.16@tcp:34:lfs.0 Request processed in 9537us (10406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545747.571295:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 163 00000100:00100000:1.0:1789545747.576694:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545747.576954:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438164736 00000100:00100000:3.0:1789545747.576968:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438164736 00000100:00100000:3.0:1789545747.577207:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 46 00000100:00100000:3.0:1789545747.577224:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+28:11513:x1876474438164736:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:3.0:1789545747.578244:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+29:11513:x1876474438164736:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 1018us (1556us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1789545747.586898:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 46 00000100:00100000:1.0:1789545747.635857:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545747.636106:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438164992 00000100:00100000:2.0:1789545747.636122:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438164992 00000100:00100000:2.0:1789545747.636201:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 164 00000100:00100000:2.0:1789545747.636214:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+29:11516:x1876474438164992:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:2.0:1789545747.636263:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545747.636291:0:10125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c1152 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de568e expref: -99 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.636456:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1159 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.636476:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1159 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.636490:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1159 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.636509:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c1160 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.636518:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c1160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.636524:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c1160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.637407:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c1167 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.637425:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c1167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.637434:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c1167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545747.637448:0:10125:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789545747.637856:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1159 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.637866:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1159 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.637873:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1159 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.637880:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1e00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545747.637885:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1159 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.637893:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1159 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.637908:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:2.0:1789545747.637912:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545747.637919:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1159 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.637925:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1159 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.637942:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c1160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.637948:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c1160 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.637953:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c1160 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.637970:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0a00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545747.637973:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c1160 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.637979:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c1160 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.637998:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994bcd248800) 00010000:00010000:2.0:1789545747.638001:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545747.638004:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c1160 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.638009:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c1160 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.638296:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c1152 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de568e expref: 32 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.638322:0:10125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c1167 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de568e expref: 31 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.638330:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248d00) 00010000:00010000:2.0:1789545747.638333:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789545747.638335:0:10125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0200, rc 0) 00000100:00100000:3.0:1789545747.638692:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+31:11516:x1876474438164992:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 2477us (2847us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1789545747.638704:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 164 00000100:00100000:1.0:1789545747.644403:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545747.644459:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545747.644599:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438165248 00000100:00100000:2.0:1789545747.644613:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438165248 00000100:00100000:2.0:1789545747.644691:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12 00000100:00100000:2.0:1789545747.644704:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a8edb7a-f384-4468-93f4-9d664f284862+31:2360:x1876474438165248:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789545747.644756:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545747.644797:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c1167 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de568e expref: 31 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.644823:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248d00) 00010000:00010000:2.0:1789545747.644828:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789545747.644897:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a8edb7a-f384-4468-93f4-9d664f284862+30:2360:x1876474438165248:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 196us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545747.644906:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12 00000100:00100000:3.0:1789545747.645295:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438165120 00000100:00100000:3.0:1789545747.645303:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438165120 00000100:00100000:3.0:1789545747.645351:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 165 00000100:00100000:3.0:1789545747.645381:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+30:11516:x1876474438165120:12345-192.168.201.16@tcp:54:lfs.0 00010000:00010000:3.0:1789545747.645460:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c1175 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.645476:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c1175 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.645488:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c1175 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.645523:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c1175 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.645531:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c1175 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.645538:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c1175 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.645545:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217f000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545747.645551:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c1175 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.645573:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c1175 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.645600:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248d00) 00010000:00010000:3.0:1789545747.645602:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789545747.645607:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c1175 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.645614:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c1175 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545747.645672:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+30:11516:x1876474438165120:12345-192.168.201.16@tcp:54:lfs.0 Request processed in 314us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545747.645681:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 165 00000100:00100000:0.0:1789545747.654199:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545747.654338:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438165504 00000100:00100000:2.0:1789545747.654351:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438165504 00000100:00100000:2.0:1789545747.654455:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 47 00000100:00100000:2.0:1789545747.654468:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+30:11516:x1876474438165504:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:2.0:1789545747.654828:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+31:11516:x1876474438165504:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 361us (777us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1789545747.654838:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 47 00000100:00100000:1.0:1789545747.874286:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545747.874968:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438165760 00000100:00100000:3.0:1789545747.874994:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438165760 00000100:00100000:3.0:1789545747.875145:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 166 00000100:00100000:3.0:1789545747.875158:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+31:11534:x1876474438165760:12345-192.168.201.16@tcp:101:cat.0 00010000:00010000:3.0:1789545747.875189:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545747.875216:0:10125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c117c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5695 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.875561:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c1183 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.875579:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c1183 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.875592:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c1183 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545747.875606:0:10125:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789545747.875793:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c117c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5695 expref: 34 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.875818:0:10125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c1183 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5695 expref: 33 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545747.875828:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248d00) 00010000:00010000:3.0:1789545747.875831:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789545747.875837:0:10125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217e400, rc 0) 00000100:00100000:3.0:1789545747.875998:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+33:11534:x1876474438165760:12345-192.168.201.16@tcp:101:cat.0 Request processed in 843us (1727us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1789545747.876007:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 166 00000100:00100000:1.0:1789545747.905216:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545747.905736:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438165888 00000100:00100000:3.0:1789545747.905751:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438165888 00000100:00100000:2.0:1789545747.906108:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 167 00000100:00100000:2.0:1789545747.906123:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+33:11535:x1876474438165888:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:2.0:1789545747.906156:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545747.906184:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c1191 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de569c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.906321:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c1198 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.906341:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c1198 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.906393:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c1198 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545747.906442:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789545747.906447:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789545747.906467:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c1198 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.906512:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c1191 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de569c expref: 35 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.906534:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c1198 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de569c expref: 34 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.906544:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:2.0:1789545747.906547:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789545747.906551:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0c00, rc 0) 00000100:00100000:2.0:1789545747.906636:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+34:11535:x1876474438165888:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 517us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545747.906644:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 167 00000100:00100000:0.0:1789545747.916032:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545747.916888:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438166272 00000100:00100000:2.0:1789545747.916905:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438166272 00000100:00100000:2.0:1789545747.917063:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 48 00000100:00100000:2.0:1789545747.917077:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+34:11535:x1876474438166272:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:2.0:1789545747.917756:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+35:11535:x1876474438166272:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 666us (1724us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1789545747.917766:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 48 00000100:00100000:1.0:1789545747.924155:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545747.924534:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438166400 00000100:00100000:0.0:1789545747.924548:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438166400 00000100:00100000:0.0:1789545747.924642:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 13 00000100:00100000:0.0:1789545747.924654:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a8edb7a-f384-4468-93f4-9d664f284862+35:11535:x1876474438166400:12345-192.168.201.16@tcp:103:lfs.0 00010000:00010000:0.0:1789545747.924686:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789545747.924718:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c1128 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5680 expref: 35 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.925138:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c1183 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5695 expref: 34 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.925156:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c102c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5641 expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.925188:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248d00) 00010000:00010000:0.0:1789545747.925203:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789545747.925294:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a8edb7a-f384-4468-93f4-9d664f284862+32:11535:x1876474438166400:12345-192.168.201.16@tcp:103:lfs.0 Request processed in 641us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545747.925303:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 13 00000100:00100000:1.0:1789545747.929620:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545747.930077:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438166528 00000100:00100000:2.0:1789545747.930091:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438166528 00000100:00100000:2.0:1789545747.930170:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 168 00000100:00100000:2.0:1789545747.930184:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+32:11535:x1876474438166528:12345-192.168.201.16@tcp:58:lfs.0 00010000:00010000:2.0:1789545747.930398:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c119f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.930419:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c119f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545747.930434:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c119f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789545747.930890:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1789545747.931028:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+32:11535:x1876474438166528:12345-192.168.201.16@tcp:58:lfs.0 Request processed in 845us (1420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545747.931039:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 168 00000100:00100000:2.0:1789545747.963805:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545747.964024:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438166656 00000100:00100000:0.0:1789545747.964038:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438166656 00000100:00100000:0.0:1789545747.964234:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 169 00000100:00100000:0.0:1789545747.964251:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+32:11537:x1876474438166656:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:0.0:1789545747.964281:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545747.964686:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c11a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de56a3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.964784:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c11ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.964803:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c11ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.964816:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c11ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.964833:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c11b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.964840:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c11b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.964869:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c11b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.965270:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c11bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.965280:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c11bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.965288:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c11bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789545747.965704:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789545747.965710:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789545747.965736:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c11bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.965750:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c11bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.965760:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c11ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.965767:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c11ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.965774:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c11ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.965780:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6800 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545747.965785:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c11ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.965802:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c11ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.965817:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:0.0:1789545747.965821:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545747.965827:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c11ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.965833:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c11ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.965849:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c11b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.965854:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c11b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.965859:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c11b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.965864:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6600 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545747.965866:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c11b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.965871:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c11b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.965877:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994bc4f11900) 00010000:00010000:0.0:1789545747.965879:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545747.965882:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c11b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.965896:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c11b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.965937:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c11a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56a3 expref: 34 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.965951:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c11bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56a3 expref: 33 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545747.965958:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248800) 00010000:00010000:0.0:1789545747.965960:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789545747.965963:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb7c00, rc 0) 00000100:00100000:0.0:1789545747.971277:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+33:11537:x1876474438166656:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 7007us (7466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545747.971297:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 169 00010000:00010000:3.0:1789545748.286734:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789545748.418538:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789545748.418551:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789545748.418628:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789545748.418637:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789545748.418948:0:11700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be3a9c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1876474454943616:192.168.201.16@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789545748.419139:0:11700:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd1c48e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789545748.442301:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545748.442341:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438166784 00000100:00100000:0.0:1789545748.442352:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438166784 00000100:00100000:0.0:1789545748.442450:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 170 00000100:00100000:0.0:1789545748.442463:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+34:11548:x1876474438166784:12345-192.168.201.16@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789545748.442505:0:10125:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789545748.444009:0:11700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be3a9c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1876474454943616:192.168.201.16@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789545748.445782:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+33:11548:x1876474438166784:12345-192.168.201.16@tcp:53:lhsmtool_posix.0 Request processed in 3302us (3475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545748.445799:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 170 00000100:00100000:3.0:1789545748.450278:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545748.457997:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438166912 00000100:00100000:0.0:1789545748.458084:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438166912 00000100:00100000:0.0:1789545748.458202:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 171 00000100:00100000:0.0:1789545748.458218:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+33:11548:x1876474438166912:12345-192.168.201.16@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789545748.458431:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c11c2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.458469:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c11c2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.458484:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c11c2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.458505:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c11c9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.458514:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c11c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.458522:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c11c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.458558:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c11d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.458569:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c11d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.458577:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c11d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789545748.458629:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789545748.458634:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789545748.458651:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c11d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.458665:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c11c2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.458685:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c11c2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.458693:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c11c2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.458700:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb7000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545748.458706:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c11c2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.458715:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c11c2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.458731:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff994bc4f11700) 00010000:00010000:0.0:1789545748.458735:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545748.459567:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c11c2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.459580:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c11c2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.459599:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c11c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.459606:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c11c9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.459614:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c11c9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.459620:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6600 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545748.459632:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c11c9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.459641:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c11c9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.459656:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff994bc4f11e00) 00010000:00010000:0.0:1789545748.459659:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545748.459663:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c11c9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.459670:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c11c9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.459692:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c11d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.459698:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c11d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.459705:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c11d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.459710:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6800 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545748.459713:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c11d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.459719:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c11d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.459727:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248800) 00010000:00010000:0.0:1789545748.459730:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545748.459752:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c11d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.459759:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c11d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545748.459981:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+33:11548:x1876474438166912:12345-192.168.201.16@tcp:34:lhsmtool_posix.0 Request processed in 1751us (9700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545748.459994:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 171 00000100:00100000:1.0:1789545748.464744:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545748.464832:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438167168 00000100:00100000:2.0:1789545748.464847:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438167168 00000100:00100000:2.0:1789545748.464934:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 172 00000100:00100000:2.0:1789545748.464948:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+33:11548:x1876474438167168:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789545748.464986:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545748.465014:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c11d7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de56aa expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.465163:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1000/0x64919c0f856c11de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.465183:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1000/0x64919c0f856c11de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.465197:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1000/0x64919c0f856c11de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545748.465211:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789545748.465338:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1000/0x64919c0f856c11de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.465346:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1000/0x64919c0f856c11de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.465353:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1000/0x64919c0f856c11de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.465454:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545748.465459:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1000/0x64919c0f856c11de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.465468:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1000/0x64919c0f856c11de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.465482:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248800) 00010000:00010000:2.0:1789545748.465485:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789545748.465491:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1000/0x64919c0f856c11de lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.465508:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1000/0x64919c0f856c11de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.465558:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c11d7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56aa expref: 35 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.465775:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff994bc4f11700) 00010000:00010000:2.0:1789545748.465778:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789545748.465783:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c11d7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56aa expref: 35 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.465794:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0000, rc 0) 00000100:00100000:2.0:1789545748.465877:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+34:11548:x1876474438167168:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 932us (1148us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1789545748.465887:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 172 00000100:00100000:2.0:1789545748.468689:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545748.472140:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438167296 00000100:00100000:1.0:1789545748.472161:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438167296 00000100:00100000:1.0:1789545748.472251:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 173 00000100:00100000:1.0:1789545748.472264:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+34:11548:x1876474438167296:12345-192.168.201.16@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789545748.472315:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789545748.472525:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+34:11548:x1876474438167296:12345-192.168.201.16@tcp:53:lhsmtool_posix.0 Request processed in 262us (3848us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545748.472535:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 173 00000100:00100000:0.0:1789545748.477981:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545748.478145:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438167552 00000100:00100000:2.0:1789545748.478162:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438167552 00000100:00100000:2.0:1789545748.478245:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 174 00000100:00100000:2.0:1789545748.478258:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+34:11548:x1876474438167552:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789545748.478290:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545748.478294:0:10125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789545748.478332:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c1198 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de569c expref: 34 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.478355:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:2.0:1789545748.478402:0:10125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789545748.478421:0:10125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c11ec lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de56b1 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789545748.490342:0:10125:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1789545748.491422:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c11f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.491447:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c11f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.491464:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c11f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.491548:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c11ec lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56b1 expref: 36 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.492638:0:10125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c11f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56b1 expref: 35 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.492649:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff994bc4f11e00) 00010000:00010000:0.0:1789545748.492653:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789545748.492657:0:10125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb6600, rc 0) 00000100:00100000:0.0:1789545748.492798:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+35:11548:x1876474438167552:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 14541us (14836us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1789545748.492817:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 174 00000100:00100000:0.0:1789545748.501257:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545748.501448:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438167808 00000100:00100000:2.0:1789545748.501462:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438167808 00000100:00100000:2.0:1789545748.501533:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 175 00000100:00100000:2.0:1789545748.501546:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+35:11548:x1876474438167808:12345-192.168.201.16@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789545748.501625:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545748.501659:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c11f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56b1 expref: 35 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.501681:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff994bc4f11e00) 00010000:00010000:2.0:1789545748.501695:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789545748.501727:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c1201 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.501745:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c1201 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.501758:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c1201 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.503807:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1208 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xe1b84b3b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.503834:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1208 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe1b84b3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.503850:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1208 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe1b84b3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.504119:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c1201 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.504127:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c1201 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.504135:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c1201 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.504141:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0c00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545748.504145:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c1201 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.504153:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c1201 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.504166:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:2.0:1789545748.504169:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545748.504175:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c1201 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.504180:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c1201 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.504192:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1208 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe1b84b3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.504199:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1208 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe1b84b3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.504205:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1208 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe1b84b3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.504218:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545748.504221:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1208 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe1b84b3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.504227:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1208 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe1b84b3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.504245:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xe1b84b3b (ffff994bcd248200) 00010000:00010000:2.0:1789545748.504248:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545748.504251:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1208 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe1b84b3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.504257:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1208 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe1b84b3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545748.504404:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+34:11548:x1876474438167808:12345-192.168.201.16@tcp:36:lhsmtool_posix.0 Request processed in 2857us (3161us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789545748.504414:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 175 00000100:00100000:2.0:1789545748.511758:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545748.512638:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438167936 00000100:00100000:0.0:1789545748.512655:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438167936 00000100:00100000:0.0:1789545748.512739:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 176 00000100:00100000:0.0:1789545748.512757:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+34:11548:x1876474438167936:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789545748.512785:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545748.512815:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c120f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de56b8 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.512867:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1216 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.512885:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.512901:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.513045:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c120f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56b8 expref: 36 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.513079:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1216 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56b8 expref: 35 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.513088:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff994bc4f11100) 00010000:00010000:0.0:1789545748.513091:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789545748.513096:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb7200, rc 0) 00000100:00100000:0.0:1789545748.513187:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+35:11548:x1876474438167936:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 436us (1438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545748.513196:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 176 00000100:00100000:0.0:1789545748.520907:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545748.522835:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438168192 00000100:00100000:2.0:1789545748.522855:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438168192 00000100:00100000:2.0:1789545748.525240:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 177 00000100:00100000:2.0:1789545748.525274:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be549bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+35:11548:x1876474438168192:12345-192.168.201.16@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789545748.525431:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c121d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.525455:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c121d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.525486:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c121d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789545748.525863:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1789545748.525875:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 362448515463ns, next at 363448512386ns, rc = 0 00000004:00010000:2.0:1789545748.526005:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000200d548b reply state 00000000a9bfece1 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c121d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545748.526018:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789545748.526924:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be549bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+37:11548:x1876474438168192:12345-192.168.201.16@tcp:36:lhsmtool_posix.0 Request processed in 1655us (6021us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1789545748.526937:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 177 00000100:00100000:0.0:1789545748.533443:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:1.0:1789545748.533718:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c121d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.533735:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c121d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.533744:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c121d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.533751:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545748.533758:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c121d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.533766:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c121d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.533788:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff994bc4f11100) 00010000:00010000:1.0:1789545748.533792:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789545748.533799:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c121d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.533806:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c121d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545748.533895:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438168320 00000100:00100000:3.0:1789545748.533910:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438168320 00000100:00100000:3.0:1789545748.533994:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 178 00000100:00100000:3.0:1789545748.534009:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+36:11548:x1876474438168320:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789545748.534051:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545748.534075:0:10125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c1224 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de56bf expref: -99 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.534156:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c1224 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56bf expref: 37 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.534172:0:10125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c1224 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56bf expref: 37 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.534209:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff994bc4f11100) 00010000:00010000:3.0:1789545748.534212:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789545748.534215:0:10125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217f000, rc 0) 00000100:00100000:3.0:1789545748.534299:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+37:11548:x1876474438168320:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 293us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545748.534316:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 178 00000100:00100000:0.0:1789545748.538024:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545748.542385:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438168448 00000100:00100000:3.0:1789545748.542406:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438168448 00000100:00100000:3.0:1789545748.542494:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 51 00000100:00100000:3.0:1789545748.542505:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5498380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+6:2358:x1876474438168448:12345-192.168.201.16@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789545748.542965:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5498380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+7:2358:x1876474438168448:12345-192.168.201.16@tcp:2:lhsmtool_posix.0 Request processed in 459us (4952us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789545748.542986:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 51 00000100:00080000:3.0:1789545748.543026:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789545748.546080:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545748.546221:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438168704 00000100:00100000:3.0:1789545748.546234:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438168704 00000100:00100000:3.0:1789545748.546311:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 49 00000100:00100000:3.0:1789545748.546325:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf4ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+37:11548:x1876474438168704:12345-192.168.201.16@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789545748.546663:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf4ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+38:11548:x1876474438168704:12345-192.168.201.16@tcp:35:lhsmtool_posix.0 Request processed in 342us (596us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1789545748.546672:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 49 00000100:00100000:3.0:1789545748.549671:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545748.549931:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438168960 00000100:00100000:2.0:1789545748.549947:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438168960 00000100:00100000:2.0:1789545748.550048:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 179 00000100:00100000:2.0:1789545748.550065:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+38:11548:x1876474438168960:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789545748.550220:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+38:11548:x1876474438168960:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 Request processed in 161us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545748.550228:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 179 00000100:00100000:3.0:1789545748.552415:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545748.552462:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438169088 00000100:00100000:2.0:1789545748.552475:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438169088 00000100:00100000:2.0:1789545748.552546:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 180 00000100:00100000:2.0:1789545748.552558:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+38:11548:x1876474438169088:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789545748.552586:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545748.552612:0:10125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c122b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de56c6 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.552712:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c1232 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.552729:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c1232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.552742:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c1232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545748.552789:0:10125:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789545748.552812:0:10125:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c1232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.552848:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c122b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56c6 expref: 40 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.552868:0:10125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c1232 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56c6 expref: 39 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.552878:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff994bc4f11100) 00010000:00010000:2.0:1789545748.552881:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789545748.552885:0:10125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0c00, rc 0) 00000100:00100000:2.0:1789545748.552982:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+39:11548:x1876474438169088:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 425us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545748.552991:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 180 00000100:00100000:1.0:1789545748.556198:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545748.556417:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438169216 00000100:00100000:2.0:1789545748.556429:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438169216 00000100:00100000:2.0:1789545748.556501:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 52 00000100:00100000:2.0:1789545748.556542:0:8211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a8edb7a-f384-4468-93f4-9d664f284862+7:2361:x1876474438169216:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789545748.556572:0:8211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545748.556600:0:8211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c1239 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de56cd expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789545748.556636:0:8211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aaa4d14, blocks: 0x1 00010000:00010000:2.0:1789545748.556661:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=362s v=(0 0) 00010000:00010000:2.0:1789545748.556667:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545748.556679:0:8211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c1239 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56cd expref: 8 pid: 8211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.556700:0:8211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c1239 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56cd expref: 8 pid: 8211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.556715:0:8211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1200, rc 0) 00000100:00100000:2.0:1789545748.556802:0:8211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a8edb7a-f384-4468-93f4-9d664f284862+8:2361:x1876474438169216:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 263us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545748.556811:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 52 00000100:00100000:0.0:1789545748.559856:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545748.560177:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438169472 00000100:00100000:2.0:1789545748.560193:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438169472 00000100:00100000:2.0:1789545748.560272:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 181 00000100:00100000:2.0:1789545748.560284:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5499f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+39:11548:x1876474438169472:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789545748.560478:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5499f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+39:11548:x1876474438169472:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 Request processed in 195us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545748.560488:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 181 00000100:00100000:1.0:1789545748.563922:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545748.564016:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438169600 00000100:00100000:3.0:1789545748.564048:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438169600 00000100:00100000:3.0:1789545748.564128:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 53 00000100:00100000:3.0:1789545748.564141:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc641ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+8:11548:x1876474438169600:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789545748.564164:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545748.564190:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a43ad8bb/0x64919c0f856c1240 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de56d4 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.564230:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c1239 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56cd expref: 9 pid: 8211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.564240:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789545748.564245:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789545748.564251:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a43ad8bb/0x64919c0f856c1240 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56d4 expref: 9 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.564293:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c1239 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56cd expref: 9 pid: 8211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.564308:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c1239 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56cd expref: 9 pid: 8211 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545748.564326:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1876474454943744:192.168.201.16@tcp:104: 00000100:00100000:3.0:1789545748.564468:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc66223c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789545748.567098:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1876474454943744:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545748.567148:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a43ad8bb/0x64919c0f856c1240 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56d4 expref: 9 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.567205:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217e400, rc 0) 00000100:00100000:3.0:1789545748.567282:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc641ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+9:11548:x1876474438169600:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 3143us (3376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545748.567292:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 53 00000100:00100000:0.0:1789545748.572750:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545748.573964:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438169728 00000100:00100000:2.0:1789545748.573994:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438169728 00010000:00010000:2.0:1789545748.574076:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c1239 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56cd expref: 9 pid: 8211 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545748.574137:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 69 00000100:00100000:2.0:1789545748.574149:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd9365c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+9:2358:x1876474438169728:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789545748.574172:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545748.574212:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c1239 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56cd expref: 9 pid: 8211 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.574229:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c1239 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56cd expref: 9 pid: 8211 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.574259:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c1239 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56cd expref: 9 pid: 8211 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.574285:0:7637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545748.574291:0:7637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545748.574301:0:7637:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a43ad8bb/0x64919c0f856c1240 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56d4 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.574748:0:7637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a43ad8bb/0x64919c0f856c1240 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56d4 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.574914:0:7637:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a43ad8bb/0x64919c0f856c1240 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56d4 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545748.574943:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf5d8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7637:1876474454943872:192.168.201.16@tcp:105: 00000100:00100000:2.0:1789545748.575144:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc8259f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789545748.580107:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545748.580211:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438169856 00000100:00100000:3.0:1789545748.580224:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438169856 00002000:00100000:3.0:1789545748.580295:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff994bdfc52d80 x1876474438169856/t0(0) o4->8a8edb7a-f384-4468-93f4-9d664f284862@192.168.201.16@tcp:214/0 lens 504/0 e 0 to 0 dl 1789545759 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789545748.580321:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994bdfc52d80 with x1876474438169856 ext(0->8) 00002000:00010000:3.0:1789545748.580328:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff994bdfc52d80 00000100:00100000:3.0:1789545748.580439:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 4 00000100:00100000:3.0:1789545748.580451:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8a8edb7a-f384-4468-93f4-9d664f284862+9:2359:x1876474438169856:12345-192.168.201.16@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789545748.581216:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8a8edb7a-f384-4468-93f4-9d664f284862+11:2359:x1876474438169856:12345-192.168.201.16@tcp:4:lhsmtool_posix.0 Request processed in 764us (1195us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789545748.581226:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 4 00002000:00100000:3.0:1789545748.581236:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff994bdfc52d80 x1876474438169856/t4294967314(0) o4->8a8edb7a-f384-4468-93f4-9d664f284862@192.168.201.16@tcp:214/0 lens 504/448 e 0 to 0 dl 1789545759 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789545748.581246:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994bdfc52d80 with x1876474438169856 ext(0->8) 00002000:00010000:3.0:1789545748.581250:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff994bdfc52d80 00000100:00100000:2.0:1789545748.581650:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf5d8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7637:1876474454943872:192.168.201.16@tcp:105: 00010000:00010000:2.0:1789545748.581684:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789545748.581716:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd9365c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+10:2358:x1876474438169728:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7570us (8987us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545748.581726:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 69 00000100:00100000:1.0:1789545748.585527:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545748.585689:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438169984 00000100:00100000:3.0:1789545748.585710:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438169984 00000100:00100000:3.0:1789545748.585801:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 182 00000100:00100000:3.0:1789545748.585814:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+39:11548:x1876474438169984:12345-192.168.201.16@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1789545748.704847:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+39:11548:x1876474438169984:12345-192.168.201.16@tcp:44:lhsmtool_posix.0 Request processed in 119021us (119321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545748.704865:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 182 00000001:00080000:3.0:1789545748.704920:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000001:00080000:3.0:1789545748.704947:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:3.0:1789545748.704953:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:3.0:1789545748.705005:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:3.0:1789545748.705024:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:1.0:1789545748.709640:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4941f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454944000:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789545748.709742:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789545748.709851:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1789545748.709869:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789545748.710028:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545748.715885:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454944000 00000100:00100000:2.0:1789545748.715911:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454944000 00000100:00100000:1.0:1789545748.715941:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438170112 00000100:00100000:1.0:1789545748.715947:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438170112 00000100:00100000:1.0:1789545748.716080:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 54 00000100:00100000:1.0:1789545748.716094:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a8edb7a-f384-4468-93f4-9d664f284862+10:2358:x1876474438170112:12345-192.168.201.16@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789545748.718653:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789545748.718670:0:8211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4942d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454944000:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789545748.720068:0:8211:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789545748.720078:0:8211:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789545748 00002000:00010000:3.0:1789545748.720081:0:8211:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789545748.720084:0:8211:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789545748 -> 1789545748 00002000:00010000:3.0:1789545748.720087:0:8211:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789545748.720230:0:8211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4942d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1876474454944000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1559us (10484us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789545748.720242:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1789545748.720330:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1789545748.724339:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff994be4941f80/2, rc 0, transno 4294967315 00000100:00100000:3.0:1789545748.724385:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4941f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454944000:0@lo:2:osp-syn-0-0.0 00000001:00080000:3.0:1789545748.758426:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:1.0:1789545748.758825:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a8edb7a-f384-4468-93f4-9d664f284862+7:2358:x1876474438170112:12345-192.168.201.16@tcp:16:lhsmtool_posix.0 Request processed in 42724us (48789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545748.758838:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 54 00000100:00100000:3.0:1789545748.772760:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545748.773416:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438170368 00000100:00100000:1.0:1789545748.773432:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438170368 00000100:00100000:1.0:1789545748.773529:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 183 00000100:00100000:1.0:1789545748.773543:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+18:11548:x1876474438170368:12345-192.168.201.16@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789545748.773628:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545748.773663:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c1232 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56c6 expref: 18 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.773688:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff994bc4f11100) 00010000:00010000:1.0:1789545748.773696:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789545748.773737:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1247 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.773755:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1247 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.773767:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1247 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789545748.775840:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000076821697 reply state 0000000052044812 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1247 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545748.775883:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789545748.777429:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+19:11548:x1876474438170368:12345-192.168.201.16@tcp:36:lhsmtool_posix.0 Request processed in 3874us (4673us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1789545748.777444:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 183 00010000:00010000:3.0:1789545748.780282:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1247 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.780315:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1247 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.780325:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1247 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.780332:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba9200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545748.780340:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1247 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.780350:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1247 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.780533:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff994bc4f11100) 00010000:00010000:3.0:1789545748.780538:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545748.780558:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1247 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.780565:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1247 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545748.780917:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545748.783218:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438170496 00000100:00100000:2.0:1789545748.783235:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438170496 00000100:00100000:3.0:1789545748.784181:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 56 00000100:00100000:3.0:1789545748.784198:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+7:2359:x1876474438170496:12345-192.168.201.16@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789545748.784485:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789545748.784490:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789545748 -> 1789545747 00002000:00010000:3.0:1789545748.784493:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789545746 00002000:00010000:3.0:1789545748.784496:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789545748 -> 1789545747 00002000:00010000:3.0:1789545748.784499:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789545748.784583:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+8:2359:x1876474438170496:12345-192.168.201.16@tcp:2:lhsmtool_posix.0 Request processed in 387us (3672us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789545748.784598:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 56 00000100:00100000:3.0:1789545748.786828:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545748.787023:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438170752 00000100:00100000:2.0:1789545748.787116:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438170752 00000100:00100000:2.0:1789545748.787199:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 184 00000100:00100000:2.0:1789545748.787212:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+18:11548:x1876474438170752:12345-192.168.201.16@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789545748.787528:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c124e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.787625:0:10125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1216 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56b8 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.787637:0:10125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c124e lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.787686:0:10125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1216 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56b8 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.787704:0:10125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1216 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56b8 expref: 18 pid: 5848 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545748.787723:0:10125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be549ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1876474454944128:192.168.201.16@tcp:104: 00000100:00100000:0.0:1789545748.787860:0:10125:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc82599c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789545748.795448:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545748.795618:0:10125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be549ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1876474454944128:192.168.201.16@tcp:104: 00010000:00010000:0.0:1789545748.795656:0:10125:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c124e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545748.795845:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438170880 00000100:00100000:1.0:1789545748.795856:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438170880 00010000:00010000:1.0:1789545748.795910:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1216 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56b8 expref: 19 pid: 5848 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545748.795952:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 70 00000100:00100000:1.0:1789545748.795976:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+19:2359:x1876474438170880:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789545748.795997:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545748.796006:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1216 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56b8 expref: 19 pid: 5848 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.796023:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1216 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56b8 expref: 19 pid: 5848 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.797228:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1216 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56b8 expref: 19 pid: 5848 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.797248:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff994bc4f11100) 00010000:00010000:1.0:1789545748.797254:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c124e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.797266:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c124e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.797281:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c124e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.797392:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789545748.797489:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+18:2359:x1876474438170880:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1524us (2055us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545748.797503:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 70 00010000:00010000:0.0:1789545748.802602:0:10125:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c124e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.802627:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c124e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.802708:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c124e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.802717:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c124e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.802726:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c124e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.802734:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545748.802739:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c124e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.802748:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c124e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.803044:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff994bc4f11100) 00010000:00010000:3.0:1789545748.803049:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789545748.803056:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c124e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.803064:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c124e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545748.803191:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+17:11548:x1876474438170752:12345-192.168.201.16@tcp:55:lhsmtool_posix.0 Request processed in 15974us (16431us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789545748.803204:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 184 00000040:00080000:1.0:1789545748.804725:0:12523:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789545748.804734:0:12523:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789545748.804786:0:12523:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789545748.804795:0:12523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789545748.820829:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545748.822472:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438171008 00000100:00100000:2.0:1789545748.822500:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438171008 00000100:00100000:2.0:1789545748.822589:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 57 00000100:00100000:2.0:1789545748.822601:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf5d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+8:2358:x1876474438171008:12345-192.168.201.16@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789545748.822660:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c1255 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.822685:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a43ad8bb/0x64919c0f856c1240 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56d4 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.822703:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545748.822708:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789545748.822714:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c1255 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.822992:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a43ad8bb/0x64919c0f856c1240 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56d4 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.823014:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a43ad8bb/0x64919c0f856c1240 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56d4 expref: 8 pid: 6693 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545748.823033:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf5db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1876474454944256:192.168.201.16@tcp:104: 00000100:00100000:2.0:1789545748.824475:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc640c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789545748.830620:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf5db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1876474454944256:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545748.830681:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c1255 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545748.835751:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545748.837921:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438171136 00000100:00100000:1.0:1789545748.837943:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438171136 00010000:00010000:1.0:1789545748.838019:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a43ad8bb/0x64919c0f856c1240 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56d4 expref: 9 pid: 6693 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545748.838092:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 71 00000100:00100000:1.0:1789545748.838104:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5190700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a8edb7a-f384-4468-93f4-9d664f284862+9:2358:x1876474438171136:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789545748.838129:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545748.838164:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a43ad8bb/0x64919c0f856c1240 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56d4 expref: 9 pid: 6693 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.838180:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a43ad8bb/0x64919c0f856c1240 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56d4 expref: 9 pid: 6693 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.838220:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a43ad8bb/0x64919c0f856c1240 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56d4 expref: 9 pid: 6693 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.838258:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789545748.838264:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789545748.838271:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c1255 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.838283:0:7636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c1255 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.838326:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789545748.838439:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5190700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a8edb7a-f384-4468-93f4-9d664f284862+8:2358:x1876474438171136:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 335us (2703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545748.838449:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 71 00010000:00010000:1.0:1789545748.839479:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c1255 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.839507:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c1255 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.839642:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c1255 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.839653:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c1255 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.839663:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c1255 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.839678:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1e00 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:1.0:1789545748.839683:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c1255 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.839693:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c1255 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.839716:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c1255 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.839725:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c1255 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545748.839890:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf5d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+7:2358:x1876474438171008:12345-192.168.201.16@tcp:1:lhsmtool_posix.0 Request processed in 17285us (19067us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545748.839902:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 57 00000100:00100000:3.0:1789545748.845271:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545748.845538:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438171392 00000100:00100000:2.0:1789545748.845553:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438171392 00000100:00100000:2.0:1789545748.845637:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 185 00000100:00100000:2.0:1789545748.845649:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+17:11548:x1876474438171392:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789545748.845760:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c125c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.845785:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c125c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.845800:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c125c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.846132:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1263 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.846145:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c1224 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56bf expref: 18 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.846154:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1263 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.846198:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c1224 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56bf expref: 18 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.846214:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c1224 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56bf expref: 18 pid: 10125 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545748.846232:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf5d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876474454944384:192.168.201.16@tcp:104: 00000100:00100000:2.0:1789545748.846507:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc640c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789545748.853599:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf5d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876474454944384:192.168.201.16@tcp:104: 00010000:00010000:1.0:1789545748.853642:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1263 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545748.865336:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545748.865405:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438171520 00000100:00100000:1.0:1789545748.865421:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438171520 00010000:00010000:1.0:1789545748.865483:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c1224 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56bf expref: 19 pid: 10125 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545748.865574:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 72 00000100:00100000:1.0:1789545748.865588:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf5d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+19:2359:x1876474438171520:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789545748.865611:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545748.865620:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c1224 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56bf expref: 19 pid: 10125 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.865637:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c1224 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56bf expref: 19 pid: 10125 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.865671:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c1224 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56bf expref: 19 pid: 10125 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.865691:0:7637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff994bc4f11100) 00010000:00010000:1.0:1789545748.865698:0:7637:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1263 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.865708:0:7637:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1263 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.865720:0:7637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1263 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545748.865767:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789545748.865794:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1263 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.865804:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1263 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545748.865852:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf5d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+18:2359:x1876474438171520:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 266us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545748.865859:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 72 00000001:00080000:2.0:1789545748.866098:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1789545748.866290:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1789545748.866397:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1789545748.866519:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf5d8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1876474454944512:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789545748.867026:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545748.867089:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bee0b99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789545748.867223:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454944512 00000100:00100000:0.0:1789545748.867236:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454944512 00000100:00100000:0.0:1789545748.867307:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789545748.867321:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf5d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1876474454944512:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789545748.867465:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf5d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1876474454944512:12345-0@lo:1000:mdt00_000.0 Request processed in 146us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545748.867475:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789545748.867691:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf5d8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1876474454944512:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789545748.868261:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1789545748.870010:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf5d8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1876474454944640:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789545748.870119:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545748.870164:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bf56a4000 going to sleep for 11 seconds 00000100:00100000:1.0:1789545748.873269:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454944640 00000100:00100000:1.0:1789545748.873305:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454944640 00000100:00100000:1.0:1789545748.873407:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789545748.873420:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1876474454944640:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789545748.873824:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5846:x1876474454944640:12345-0@lo:1000:mdt00_000.0 Request processed in 406us (3703us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789545748.873833:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789545748.874707:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf5d8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1876474454944640:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1789545748.874786:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1263 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.874801:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1263 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.874811:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1263 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.874818:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1c00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545748.874824:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1263 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.874836:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1263 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.874879:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff994bc4f11100) 00010000:00010000:0.0:1789545748.874882:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789545748.874892:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1263 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.874900:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1263 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.874947:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c119f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.874955:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c119f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.874971:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c119f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.874977:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0a00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545748.874980:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c119f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.874986:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c119f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.874995:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248800) 00010000:00010000:0.0:1789545748.874998:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789545748.875001:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c119f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.875008:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c119f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.875408:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c126a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.875430:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c11bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56a3 expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545748.875441:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c126a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.875557:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c11bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56a3 expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.875585:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c11bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56a3 expref: 21 pid: 5847 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545748.875602:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf5d9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876474454944768:192.168.201.16@tcp:104: 00000100:00100000:2.0:1789545748.875714:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc640ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1789545748.882311:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf5d9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876474454944768:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545748.882353:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c126a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545748.882812:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545748.882939:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438171648 00000100:00100000:2.0:1789545748.882952:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438171648 00010000:00010000:2.0:1789545748.883024:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c11bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56a3 expref: 22 pid: 5847 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545748.883072:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 73 00000100:00100000:2.0:1789545748.883084:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be549ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+22:2359:x1876474438171648:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789545748.883103:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545748.883113:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c11bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56a3 expref: 22 pid: 5847 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.883143:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c11bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56a3 expref: 22 pid: 5847 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.883174:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c11bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56a3 expref: 22 pid: 5847 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.883193:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248800) 00010000:00010000:2.0:1789545748.883198:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c126a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.883211:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c126a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.883221:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c126a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545748.883259:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789545748.883353:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be549ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+21:2359:x1876474438171648:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 271us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545748.883397:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 73 00010000:00010000:3.0:1789545748.883930:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c126a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.883940:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c126a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.883957:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c126a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.883975:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c126a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.883984:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c126a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.883991:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6600 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545748.883997:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c126a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.884006:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c126a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.884041:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248800) 00010000:00010000:3.0:1789545748.884045:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545748.884050:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c126a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.884056:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c126a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.884070:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c125c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.884077:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c125c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.884083:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c125c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.884089:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545748.884092:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c125c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.884099:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c125c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.884108:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248800) 00010000:00010000:3.0:1789545748.884110:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789545748.884113:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c125c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.884119:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c125c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545748.884478:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+20:11548:x1876474438171392:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 Request processed in 38826us (39217us total) trans 4294967466 rc 0/0 00000040:00080000:0.0:1789545748.884746:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789545748.884752:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789545748.885249:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1789545748.885262:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789545748.886338:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 185 00000020:00080000:3.0:1789545748.886352:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1789545748.889111:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545748.889340:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438171904 00000100:00100000:3.0:1789545748.889355:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438171904 00000100:00100000:3.0:1789545748.889450:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 50 00000100:00100000:3.0:1789545748.889463:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8cc6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+20:11548:x1876474438171904:12345-192.168.201.16@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789545748.890671:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789545748.890859:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1789545748.890926:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c1271 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.890947:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c1271 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.890973:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c1271 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.890984:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c1271 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.890992:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c1271 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.890999:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c1271 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.891019:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789545748.891181:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8cc6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+22:11548:x1876474438171904:12345-192.168.201.16@tcp:35:lhsmtool_posix.0 Request processed in 1716us (2080us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1789545748.891192:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 50 00000020:00080000:3.0:1789545748.891198:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789545748.891283:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789545748.891292:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c1271 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.891301:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217fa00 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545748.891306:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c1271 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.891316:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c1271 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.891332:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff994bc4f9e100) 00010000:00010000:3.0:1789545748.891335:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789545748.891340:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c1271 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.891347:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c1271 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545748.891392:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545748.891394:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545748.891396:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789545749.053397:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876474454945152:0@lo:400:kworker.0 00000100:00100000:3.0:1789545749.053492:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545749.053581:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789545749.053588:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454945280:0@lo:400:kworker.0 00000100:00100000:3.0:1789545749.053634:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545749.053678:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454945152 00000100:00100000:3.0:1789545749.053688:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454945152 00000100:00100000:3.0:1789545749.053748:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454945280 00000100:00100000:3.0:1789545749.053751:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454945280 00000100:00100000:1.0:1789545749.053874:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf4ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876474454945024:0@lo:400:kworker.0 00000100:00100000:1.0:1789545749.053909:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545749.053934:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789545749.053940:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be5192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beb86ab1-4563-44b1-afd1-f08a43b0622e:3314:1876474454944896:0@lo:400:kworker.0 00000100:00100000:1.0:1789545749.053987:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545749.054012:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454945408:0@lo:400:kworker.0 00000100:00100000:1.0:1789545749.054054:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545749.054084:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454944896 00000100:00100000:1.0:1789545749.054087:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454944896 00000100:00100000:1.0:1789545749.054121:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789545749.054131:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3314:x1876474454944896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545749.054191:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3314:x1876474454944896:12345-0@lo:400:kworker.0 Request processed in 60us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545749.054199:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789545749.054238:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454945408 00000100:00100000:1.0:1789545749.054241:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454945408 00000100:00100000:1.0:1789545749.054264:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789545749.054269:0:8211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bffcdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3314:x1876474454945408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545749.054295:0:8211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bffcdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3314:x1876474454945408:12345-0@lo:400:kworker.0 Request processed in 25us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545749.054314:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789545749.054384:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be5192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beb86ab1-4563-44b1-afd1-f08a43b0622e:3314:1876474454944896:0@lo:400:kworker.0 00000100:00100000:1.0:1789545749.054398:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454945408:0@lo:400:kworker.0 00000100:00100000:1.0:1789545749.054443:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454945024 00000100:00100000:1.0:1789545749.054445:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454945024 00000100:00080000:0.0:1789545749.054571:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789545749.054577:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789545749.055229:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789545749.056011:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789545749.056146:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876474454945024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545749.056263:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876474454945024:12345-0@lo:400:kworker.0 Request processed in 242us (2352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545749.056271:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789545749.056356:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf4ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876474454945024:0@lo:400:kworker.0 00000100:00100000:2.0:1789545749.056573:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876474454945152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545749.058206:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876474454945152:12345-0@lo:400:kworker.0 Request processed in 2956us (4702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545749.058222:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789545749.058651:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789545749.058666:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454945280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545749.058783:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454945280:12345-0@lo:400:kworker.0 Request processed in 122us (5147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545749.058789:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789545749.058892:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876474454945152:0@lo:400:kworker.0 00000100:00100000:1.0:1789545749.058924:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454945280:0@lo:400:kworker.0 00000001:00080000:2.0:1789545749.096662:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1789545749.096882:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00010000:00010000:2.0:1789545749.310650:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789545749.564721:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789545749.564915:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf4ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454945664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789545749.565477:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454945536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789545749.566019:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545749.566106:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454945664 00000100:00100000:1.0:1789545749.566117:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454945664 00000100:00100000:1.0:1789545749.566174:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789545749.566184:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4fc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454945664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789545749.566229:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789545749.566291:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4fc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454945664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545749.566299:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789545749.573504:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1789545749.573522:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:3.0:1789545749.574615:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff994be3a9d880, transno 4294967307 00000100:00100000:3.0:1789545749.574678:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf4ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454945664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789545749.575354:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545749.575801:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454945536 00000100:00100000:3.0:1789545749.575816:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454945536 00000100:00100000:3.0:1789545749.575883:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789545749.575896:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1876474454945536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789545749.575928:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1789545749.576020:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1876474454945536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545749.576743:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789545749.576761:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454945536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789545749.939124:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545749.939261:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545749.939299:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545749.939327:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545749.939398:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545749.939429:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438172544 00000100:00100000:2.0:1789545749.939443:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438172544 00000100:00100000:2.0:1789545749.939518:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438172160 00000100:00100000:2.0:1789545749.939531:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438172160 00000100:00100000:2.0:1789545749.939564:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 152 00000100:00100000:2.0:1789545749.939576:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2359:x1876474438172544:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545749.939598:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438172288 00000100:00100000:1.0:1789545749.939602:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438172288 00000100:00100000:1.0:1789545749.939634:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438172416 00000100:00100000:1.0:1789545749.939636:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438172416 00000100:00100000:1.0:1789545749.939660:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 88 00000100:00100000:1.0:1789545749.939667:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf5d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a8edb7a-f384-4468-93f4-9d664f284862+7:2359:x1876474438172288:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545749.939680:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2359:x1876474438172544:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 107us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545749.939689:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 152 00000100:00100000:1.0:1789545749.939695:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf5d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a8edb7a-f384-4468-93f4-9d664f284862+7:2359:x1876474438172288:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 31us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545749.939701:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 88 00000100:00100000:2.0:1789545749.939711:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 153 00000100:00100000:1.0:1789545749.939712:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 89 00000100:00100000:2.0:1789545749.939717:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf5dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+22:2359:x1876474438172160:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545749.939717:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf5da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a8edb7a-f384-4468-93f4-9d664f284862+5:2359:x1876474438172416:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545749.939741:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf5da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a8edb7a-f384-4468-93f4-9d664f284862+5:2359:x1876474438172416:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 23us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545749.939743:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf5dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+22:2359:x1876474438172160:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 27us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545749.939748:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 89 00000100:00100000:2.0:1789545749.939749:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 153 00000100:00080000:2.0:1789545749.939817:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789545749.939824:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789545749.944194:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438172032 00000100:00100000:0.0:1789545749.945774:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438172032 00000100:00100000:0.0:1789545749.945888:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 296 00000100:00100000:0.0:1789545749.945904:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2359:x1876474438172032:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:0.0:1789545749.946201:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2359:x1876474438172032:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 300us (7092us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545749.946720:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 296 00010000:00010000:3.0:1789545750.333778:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789545750.739669:0:12577:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789545750.739685:0:12577:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789545750.739728:0:12577:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789545750.739734:0:12577:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789545750.948596:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545750.948682:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438172800 00000100:00100000:3.0:1789545750.948696:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438172800 00000100:00100000:3.0:1789545750.948771:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 186 00000100:00100000:3.0:1789545750.948796:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be549a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+22:11567:x1876474438172800:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:3.0:1789545750.948824:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545750.948851:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c1278 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de56db expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545750.949096:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c127f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545750.949116:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c127f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545750.949132:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c127f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545750.949147:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789545750.949320:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c1278 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56db expref: 25 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545750.949342:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c127f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56db expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545750.949353:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:3.0:1789545750.949389:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789545750.949394:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994c0217fa00, rc 0) 00000100:00100000:3.0:1789545750.949475:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be549a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+24:11567:x1876474438172800:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 681us (892us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1789545750.949484:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 186 00000100:00100000:3.0:1789545750.954586:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545750.954911:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438172928 00000100:00100000:2.0:1789545750.954935:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438172928 00000100:00100000:2.0:1789545750.955023:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 187 00000100:00100000:2.0:1789545750.955037:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+24:11567:x1876474438172928:12345-192.168.201.16@tcp:34:lfs.0 00010000:00010000:2.0:1789545750.955148:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c128d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545750.955171:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c128d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545750.955187:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c128d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545750.955207:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1294 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545750.955216:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1294 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545750.955224:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1294 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545750.955583:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c129b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545750.955594:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c129b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545750.955603:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c129b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789545750.955673:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c129b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545750.955689:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c128d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545750.955698:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c128d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545750.955707:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c128d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545750.955714:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0c00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545750.955720:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c128d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545750.955730:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c128d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545750.955746:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:2.0:1789545750.955750:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545750.955757:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c128d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545750.955764:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c128d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545750.955777:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1294 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545750.955785:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1294 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545750.955798:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1294 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545750.955804:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545750.955808:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1294 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545750.955816:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1294 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545750.955825:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994bcd248000) 00010000:00010000:2.0:1789545750.955828:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545750.955831:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1294 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545750.955838:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1294 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545750.955855:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c129b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545750.955863:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c129b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545750.955869:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c129b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545750.955873:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545750.955876:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c129b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545750.955891:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c129b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545750.955899:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bcd248500) 00010000:00010000:2.0:1789545750.955901:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545750.955904:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c129b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545750.955909:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c129b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545750.956032:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+24:11567:x1876474438172928:12345-192.168.201.16@tcp:34:lfs.0 Request processed in 995us (1457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545750.956042:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 187 00000100:00100000:2.0:1789545751.030731:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545751.030973:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438173184 00000100:00100000:3.0:1789545751.031084:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438173184 00000100:00100000:3.0:1789545751.031172:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 188 00000100:00100000:3.0:1789545751.031184:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf5da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+24:11570:x1876474438173184:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:3.0:1789545751.031211:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545751.031238:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c12a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de56e2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.031347:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c12a9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789545751.031353:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789545751.031574:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c12a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.031589:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c12a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.031607:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c12b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.031615:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c12b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.031621:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c12b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.031956:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a600/0x64919c0f856c12b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.031966:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a600/0x64919c0f856c12b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.031973:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a600/0x64919c0f856c12b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545751.032073:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789545751.032192:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c12a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.032201:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c12a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.032209:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c12a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.032217:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217f000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545751.032222:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c12a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.032232:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c12a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.032246:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:3.0:1789545751.032250:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545751.032256:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c12a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.032264:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f000/0x64919c0f856c12a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.032276:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c12b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.032283:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c12b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.032300:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c12b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.032305:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217e400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545751.032308:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c12b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.032315:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c12b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.032322:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994bc4f9e100) 00010000:00010000:3.0:1789545751.032324:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545751.032327:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c12b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.032332:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217e400/0x64919c0f856c12b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.032623:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f600/0x64919c0f856c12a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56e2 expref: 27 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.032641:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a600/0x64919c0f856c12b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56e2 expref: 26 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.032648:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bc4f9e500) 00010000:00010000:3.0:1789545751.032650:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789545751.032653:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bee11a600, rc 0) 00000100:00100000:3.0:1789545751.032735:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf5da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+26:11570:x1876474438173184:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 1553us (2016us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1789545751.032752:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 188 00000100:00100000:0.0:1789545751.046140:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545751.046518:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438173312 00000100:00100000:1.0:1789545751.046534:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438173312 00000100:00100000:1.0:1789545751.046682:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 189 00000100:00100000:1.0:1789545751.046700:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be549a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+26:11570:x1876474438173312:12345-192.168.201.16@tcp:54:lfs.0 00010000:00010000:1.0:1789545751.046810:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c12c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.046835:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c12c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.046849:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c12c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.046905:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c12c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.046913:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c12c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.046933:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c12c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.046941:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba9200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545751.046947:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c12c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.047029:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c12c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.047051:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bc4f9e500) 00010000:00010000:1.0:1789545751.047055:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789545751.047062:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c12c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.047069:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c12c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545751.047182:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be549a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+26:11570:x1876474438173312:12345-192.168.201.16@tcp:54:lfs.0 Request processed in 488us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545751.047191:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 189 00000100:00100000:0.0:1789545751.051622:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545751.052338:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438173568 00000100:00100000:1.0:1789545751.052352:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438173568 00000100:00100000:1.0:1789545751.052590:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 51 00000100:00100000:1.0:1789545751.052626:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be549b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+26:11570:x1876474438173568:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:1.0:1789545751.053063:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be549b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+27:11570:x1876474438173568:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 439us (1453us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1789545751.053072:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 51 00000100:00100000:1.0:1789545751.115416:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545751.119060:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438173824 00000100:00100000:3.0:1789545751.119085:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438173824 00000100:00100000:3.0:1789545751.119189:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 190 00000100:00100000:3.0:1789545751.119203:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc641c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+27:11096:x1876474438173824:12345-192.168.201.16@tcp:101:bash.0 00010000:00010000:3.0:1789545751.119240:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545751.119270:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ba00/0x64919c0f856c12cc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de56e9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.119624:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b800/0x64919c0f856c12d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.119644:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a600/0x64919c0f856c12b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56e2 expref: 28 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.119652:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b800/0x64919c0f856c12d3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.119692:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a600/0x64919c0f856c12b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56e2 expref: 28 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.119708:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a600/0x64919c0f856c12b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56e2 expref: 28 pid: 5848 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545751.119723:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb1b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1876474454945792:192.168.201.16@tcp:104: 00000100:00100000:3.0:1789545751.119900:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8db1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789545751.131590:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545751.131708:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb1b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1876474454945792:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545751.131763:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b800/0x64919c0f856c12d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545751.131952:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438173952 00000100:00100000:2.0:1789545751.131963:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438173952 00010000:00010000:2.0:1789545751.132096:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a600/0x64919c0f856c12b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56e2 expref: 29 pid: 5848 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545751.132156:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 74 00000100:00100000:2.0:1789545751.132167:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a8edb7a-f384-4468-93f4-9d664f284862+29:2359:x1876474438173952:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789545751.132187:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545751.132194:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a600/0x64919c0f856c12b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56e2 expref: 29 pid: 5848 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545751.132209:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a600/0x64919c0f856c12b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56e2 expref: 29 pid: 5848 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545751.132340:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a600/0x64919c0f856c12b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56e2 expref: 29 pid: 5848 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545751.133131:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bc4f9e500) 00010000:00010000:2.0:1789545751.133140:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b800/0x64919c0f856c12d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545751.133152:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b800/0x64919c0f856c12d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545751.133161:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b800/0x64919c0f856c12d3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545751.133202:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789545751.133411:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b800/0x64919c0f856c12d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.133421:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b800/0x64919c0f856c12d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545751.133447:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789545751.133661:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ba00/0x64919c0f856c12cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56e9 expref: 30 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.133683:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b800/0x64919c0f856c12d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56e9 expref: 29 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.133691:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bc4f9e500) 00010000:00010000:3.0:1789545751.133694:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789545751.133697:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bee11b800, rc 0) 00000100:00100000:2.0:1789545751.133944:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a8edb7a-f384-4468-93f4-9d664f284862+29:2359:x1876474438173952:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1775us (2360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545751.133957:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 74 00000100:00100000:3.0:1789545751.134634:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc641c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+28:11096:x1876474438173824:12345-192.168.201.16@tcp:101:bash.0 Request processed in 15429us (19272us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1789545751.134645:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 190 00000100:00100000:2.0:1789545751.148231:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545751.148352:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438174208 00000100:00100000:1.0:1789545751.148612:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438174208 00000100:00100000:1.0:1789545751.148737:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 191 00000100:00100000:1.0:1789545751.148749:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf5db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+28:11096:x1876474438174208:12345-192.168.201.16@tcp:36:bash.0 00010000:00010000:1.0:1789545751.149154:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c12e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.149176:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c12e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.149189:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c12e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789545751.149258:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1789545751.149289:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f7c99283 reply state 00000000bd47c15c transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c12e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545751.149299:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789545751.149352:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1789545751.149530:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf5db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+32:11096:x1876474438174208:12345-192.168.201.16@tcp:36:bash.0 Request processed in 781us (1312us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1789545751.149538:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 191 00000020:00080000:1.0:1789545751.149544:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1789545751.155658:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c12e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.155677:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c12e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.155683:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c12e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.155687:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba9200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545751.155691:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c12e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.155697:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c12e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.155713:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bc4f9e500) 00010000:00010000:1.0:1789545751.155716:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545751.155720:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c12e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.155724:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c12e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545751.156694:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545751.156997:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438174336 00000100:00100000:0.0:1789545751.157029:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438174336 00000100:00100000:0.0:1789545751.157094:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 192 00000100:00100000:0.0:1789545751.157106:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf5db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+31:11096:x1876474438174336:12345-192.168.201.16@tcp:101:bash.0 00010000:00010000:0.0:1789545751.157136:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545751.157161:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c12e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de56f0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.157236:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c12e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56f0 expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.157248:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c12e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56f0 expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.157271:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bc4f9e500) 00010000:00010000:0.0:1789545751.157274:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789545751.157279:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb6000, rc 0) 00000100:00100000:0.0:1789545751.157616:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf5db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+32:11096:x1876474438174336:12345-192.168.201.16@tcp:101:bash.0 Request processed in 511us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545751.157625:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 192 00000100:00100000:0.0:1789545751.165186:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545751.166119:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438174464 00000100:00100000:1.0:1789545751.166134:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438174464 00000100:00100000:1.0:1789545751.166286:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 58 00000100:00100000:1.0:1789545751.166310:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be549b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a8edb7a-f384-4468-93f4-9d664f284862+7:11096:x1876474438174464:12345-192.168.201.16@tcp:101:bash.0 00010000:00010000:1.0:1789545751.166344:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545751.166388:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb0c3f3/0x64919c0f856c12ef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de56f7 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789545751.166443:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aaa4d13, atime: 0x6aaa4d12, ctime: 0x6aaa4d13, blocks: 0xb 00010000:00010000:1.0:1789545751.166477:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=365s v=(0 0) 00010000:00010000:1.0:1789545751.166482:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789545751.166492:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb0c3f3/0x64919c0f856c12ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56f7 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.166523:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002fb0c3f3/0x64919c0f856c12ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56f7 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.166540:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba9200, rc 0) 00000100:00100000:1.0:1789545751.166629:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be549b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a8edb7a-f384-4468-93f4-9d664f284862+8:11096:x1876474438174464:12345-192.168.201.16@tcp:101:bash.0 Request processed in 323us (1456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545751.166637:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 58 00000100:00080000:2.0:1789545751.167227:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789545751.180993:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545751.184098:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438174592 00000100:00100000:0.0:1789545751.184121:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438174592 00002000:00010000:0.0:1789545751.184186:0:6697:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1789545751.184192:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994bdf5daa00 with x1876474438174592 ext(0->18446744073709551615) 00002000:00010000:0.0:1789545751.184208:0:6697:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff994bdf5daa00. 00000100:00100000:0.0:1789545751.184262:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 5 00000100:00100000:0.0:1789545751.184274:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf5daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8a8edb7a-f384-4468-93f4-9d664f284862+8:2358:x1876474438174592:12345-192.168.201.16@tcp:10:bash.0 00002000:00010000:0.0:1789545751.184742:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789545751.184747:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789545747 -> 1789545751 00002000:00010000:0.0:1789545751.184750:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1789545746 -> 1789545746 00002000:00010000:0.0:1789545751.184752:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789545747 -> 1789545751 00002000:00010000:0.0:1789545751.184755:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789545751.184841:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf5daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8a8edb7a-f384-4468-93f4-9d664f284862+9:2358:x1876474438174592:12345-192.168.201.16@tcp:10:bash.0 Request processed in 567us (4792us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1789545751.184850:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 5 00002000:00010000:0.0:1789545751.184855:0:6697:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1789545751.184857:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994bdf5daa00 with x1876474438174592 ext(0->18446744073709551615) 00002000:00010000:0.0:1789545751.184863:0:6697:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff994bdf5daa00. 00000100:00100000:0.0:1789545751.298909:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545751.300572:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438174720 00000100:00100000:1.0:1789545751.300591:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438174720 00000100:00100000:1.0:1789545751.300683:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 193 00000100:00100000:1.0:1789545751.300696:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be549aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+32:11584:x1876474438174720:12345-192.168.201.16@tcp:34:lfs.0 00010000:00010000:1.0:1789545751.301558:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c12f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.301596:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c12f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.301611:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c12f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.301650:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c12fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.301658:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c12fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.301664:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c12fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.304710:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1304 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.304743:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.304758:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789545751.304826:0:10125:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.304841:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c12f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.304848:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c12f6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.304856:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c12f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.304864:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba9000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545751.304869:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c12f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.304898:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c12f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.304927:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:1.0:1789545751.304931:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545751.304938:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c12f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.304944:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c12f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.305159:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c12fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.305164:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c12fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.305168:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c12fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.305171:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba9800 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545751.305173:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c12fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.305176:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c12fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.305182:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994bc4ffec00) 00010000:00010000:1.0:1789545751.305183:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545751.305186:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c12fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.305201:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c12fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.305220:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.305227:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1304 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.305233:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1304 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.305239:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba8200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545751.305242:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1304 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.305303:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1304 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.305313:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bc4f9e500) 00010000:00010000:1.0:1789545751.305316:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545751.305319:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1304 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.305326:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1304 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545751.306742:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be549aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+32:11584:x1876474438174720:12345-192.168.201.16@tcp:34:lfs.0 Request processed in 6032us (7831us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545751.306758:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 193 00010000:00010000:3.0:1789545751.358312:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545751.365461:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545751.365641:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438174976 00000100:00100000:0.0:1789545751.365657:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438174976 00000100:00100000:0.0:1789545751.365732:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 194 00000100:00100000:0.0:1789545751.365744:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf5d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+32:11587:x1876474438174976:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:0.0:1789545751.365772:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545751.365799:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c130b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de56fe expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.365908:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1312 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.365935:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1312 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.365958:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1312 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.365999:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c1319 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.366008:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c1319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.366015:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c1319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.366459:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c1320 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.366469:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c1320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.366477:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c1320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789545751.366490:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789545751.366620:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1312 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.366629:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1312 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.366638:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1312 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.366645:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb7000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545751.366651:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1312 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.366672:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1312 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.366689:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:0.0:1789545751.366692:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545751.366700:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1312 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.366706:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1312 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.366721:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c1319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.366727:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c1319 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.366732:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c1319 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.366737:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6600 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545751.366740:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c1319 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.366746:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c1319 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.366753:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994bc4f11b00) 00010000:00010000:0.0:1789545751.366756:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545751.366758:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c1319 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.366775:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c1319 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.366829:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c130b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56fe expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.366846:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c1320 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56fe expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.366853:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bc4f9e500) 00010000:00010000:0.0:1789545751.366856:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789545751.366858:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb6400, rc 0) 00000100:00100000:0.0:1789545751.367002:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf5d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+34:11587:x1876474438174976:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 1259us (1558us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1789545751.367010:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 194 00000100:00100000:2.0:1789545751.376694:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545751.376801:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438175104 00000100:00100000:3.0:1789545751.376815:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438175104 00000100:00100000:3.0:1789545751.376895:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 195 00000100:00100000:3.0:1789545751.376907:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf5d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+34:11587:x1876474438175104:12345-192.168.201.16@tcp:54:lfs.0 00010000:00010000:3.0:1789545751.377021:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ba00/0x64919c0f856c132e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.377060:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b800/0x64919c0f856c12d3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56e9 expref: 34 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.377070:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ba00/0x64919c0f856c132e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.377118:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b800/0x64919c0f856c12d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56e9 expref: 34 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.377134:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b800/0x64919c0f856c12d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56e9 expref: 34 pid: 5848 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545751.377151:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb1b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876474454945920:192.168.201.16@tcp:104: 00000100:00100000:3.0:1789545751.377288:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8db1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789545751.387333:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545751.387521:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438175360 00000100:00100000:0.0:1789545751.387534:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438175360 00000100:00100000:0.0:1789545751.387613:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 52 00000100:00100000:0.0:1789545751.387626:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf5d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+35:5593:x1876474438175360:12345-192.168.201.16@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789545751.388106:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf5d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+36:5593:x1876474438175360:12345-192.168.201.16@tcp:35:ldlm_bl.0 Request processed in 480us (786us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1789545751.388116:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 52 00000100:00100000:3.0:1789545751.388408:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb1b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876474454945920:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545751.388440:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ba00/0x64919c0f856c132e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545751.396589:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545751.396728:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438175488 00000100:00100000:1.0:1789545751.396742:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438175488 00010000:00010000:1.0:1789545751.396804:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b800/0x64919c0f856c12d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56e9 expref: 36 pid: 5848 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545751.396857:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 75 00000100:00100000:1.0:1789545751.396869:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf5db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+36:2358:x1876474438175488:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789545751.396891:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545751.396899:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b800/0x64919c0f856c12d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56e9 expref: 36 pid: 5848 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.396925:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b800/0x64919c0f856c12d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56e9 expref: 36 pid: 5848 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.396954:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b800/0x64919c0f856c12d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56e9 expref: 36 pid: 5848 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.396977:0:7637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bc4f9e500) 00010000:00010000:1.0:1789545751.396983:0:7637:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ba00/0x64919c0f856c132e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.396995:0:7637:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ba00/0x64919c0f856c132e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.397004:0:7637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ba00/0x64919c0f856c132e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.397043:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789545751.397116:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf5db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+35:2358:x1876474438175488:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 248us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545751.397145:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 75 00010000:00010000:3.0:1789545751.397281:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ba00/0x64919c0f856c132e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.397292:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ba00/0x64919c0f856c132e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.397336:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ba00/0x64919c0f856c132e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.397345:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ba00/0x64919c0f856c132e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.397410:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ba00/0x64919c0f856c132e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.397418:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bee11ba00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545751.397423:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ba00/0x64919c0f856c132e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.397432:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ba00/0x64919c0f856c132e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.397442:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bc4f9e500) 00010000:00010000:3.0:1789545751.397445:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789545751.397450:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ba00/0x64919c0f856c132e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.397457:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ba00/0x64919c0f856c132e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545751.397506:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf5d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+34:11587:x1876474438175104:12345-192.168.201.16@tcp:54:lfs.0 Request processed in 20601us (20827us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545751.397515:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 195 00000100:00100000:2.0:1789545751.408120:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545751.408490:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438175744 00000100:00100000:0.0:1789545751.408516:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438175744 00000100:00100000:0.0:1789545751.408595:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 53 00000100:00100000:0.0:1789545751.408608:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+34:11587:x1876474438175744:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:0.0:1789545751.408977:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+35:11587:x1876474438175744:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 370us (873us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1789545751.408986:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 53 00000100:00100000:2.0:1789545751.508956:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545751.509329:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438176000 00000100:00100000:0.0:1789545751.509345:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438176000 00000100:00100000:0.0:1789545751.509452:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 196 00000100:00100000:0.0:1789545751.509464:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+35:11598:x1876474438176000:12345-192.168.201.16@tcp:101:cat.0 00010000:00010000:0.0:1789545751.509609:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545751.509638:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c1335 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5705 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.509744:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c133c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.509763:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c133c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.509776:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c133c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.509793:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1343 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.509801:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1343 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.509808:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1343 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.510153:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c134a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.510171:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c134a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.510179:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c134a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789545751.510193:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1789545751.510463:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c133c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.510472:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c133c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.510479:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c133c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.510680:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6600 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545751.510687:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c133c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.510695:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c133c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.510709:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:0.0:1789545751.510766:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545751.510773:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c133c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.510781:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c133c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.510799:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1343 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.510814:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1343 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.510821:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1343 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.510826:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb7000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545751.510829:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1343 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.510833:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1343 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.510839:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994bc4f11b00) 00010000:00010000:0.0:1789545751.510841:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545751.510843:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1343 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.510847:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1343 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.510899:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c1335 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5705 expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.510908:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c134a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5705 expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.510924:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bc4f9e500) 00010000:00010000:0.0:1789545751.510927:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789545751.510935:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb6800, rc 0) 00000100:00100000:0.0:1789545751.511082:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+37:11598:x1876474438176000:12345-192.168.201.16@tcp:101:cat.0 Request processed in 1621us (2144us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1789545751.511091:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 196 00000100:00100000:2.0:1789545751.517981:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545751.518390:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438176256 00000100:00100000:0.0:1789545751.518404:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438176256 00000100:00100000:0.0:1789545751.518549:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 54 00000100:00100000:0.0:1789545751.518564:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+37:11598:x1876474438176256:12345-192.168.201.16@tcp:35:cat.0 00000100:00100000:0.0:1789545751.518910:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+38:11598:x1876474438176256:12345-192.168.201.16@tcp:35:cat.0 Request processed in 349us (942us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1789545751.518930:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 54 00000100:00100000:2.0:1789545751.542840:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545751.542952:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438176512 00000100:00100000:1.0:1789545751.542965:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438176512 00000100:00100000:1.0:1789545751.543095:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 197 00000100:00100000:1.0:1789545751.543108:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+38:11599:x1876474438176512:12345-192.168.201.16@tcp:36:rm.0 00010000:00010000:1.0:1789545751.543193:0:10125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789545751.543230:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c134a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5705 expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.543268:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c1320 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56fe expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.543282:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c12e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56f0 expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.543293:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bc4f9e500) 00010000:00010000:1.0:1789545751.543307:0:10125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789545751.543336:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1358 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.543353:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1358 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.543392:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1358 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.543410:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c135f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.543440:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c135f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.543447:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c135f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.544009:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c1366 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.544022:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c1366 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.544030:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c1366 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789545751.545484:0:10125:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1789545751.545790:0:10125:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 365468429755ns, next at 366468422486ns, rc = 0 00010000:00010000:1.0:1789545751.545932:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c136d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.545952:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c136d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.545965:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c136d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.545974:0:10125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c136d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.545981:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c136d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.546004:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c136d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.546040:0:10125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789545751.546069:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c1366 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.546075:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c1366 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.546082:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c1366 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.546088:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba9000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545751.546093:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c1366 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.546102:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c1366 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.546116:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bc4ffe600) 00010000:00010000:1.0:1789545751.546118:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789545751.546124:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c1366 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.546130:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c1366 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.546155:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1358 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.546161:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1358 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.546174:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1358 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.546179:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba8200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545751.546182:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1358 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.546189:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1358 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.546197:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:1.0:1789545751.546200:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545751.546204:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1358 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.546210:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1358 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789545751.546222:0:10125:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb6d45b3 reply state 0000000072f7d8ca transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c135f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545751.546234:0:10125:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789545751.546990:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+37:11599:x1876474438176512:12345-192.168.201.16@tcp:36:rm.0 Request processed in 3875us (4152us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1789545751.547002:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 197 00010000:00010000:2.0:1789545751.550506:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789545751.550528:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c136d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545751.550544:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba8800 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:2.0:1789545751.550549:0:8453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c136d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545751.550561:0:8453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c136d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545751.550586:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994bc4ffe600) 00010000:00010000:2.0:1789545751.550590:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789545751.550596:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c136d lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545751.550604:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c136d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545751.550645:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545751.550648:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545751.550650:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545751.553805:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c135f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.553828:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c135f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.553837:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c135f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.553843:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba9800 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545751.553871:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c135f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.553879:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c135f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.553900:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994bc4ffec00) 00010000:00010000:3.0:1789545751.553904:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545751.553910:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c135f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.553927:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c135f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545751.606110:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545751.606422:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438176768 00000100:00100000:3.0:1789545751.606440:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438176768 00000100:00100000:3.0:1789545751.606533:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 198 00000100:00100000:3.0:1789545751.606546:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+36:11605:x1876474438176768:12345-192.168.201.16@tcp:101:bash.0 00010000:00010000:3.0:1789545751.606579:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545751.606606:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ba00/0x64919c0f856c1374 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de570c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.606861:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b000/0x64919c0f856c137b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.606881:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b000/0x64919c0f856c137b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.606893:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b000/0x64919c0f856c137b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.606939:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11be00/0x64919c0f856c1382 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.606947:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11be00/0x64919c0f856c1382 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.606955:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11be00/0x64919c0f856c1382 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789545751.608145:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1789545751.608862:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ae00/0x64919c0f856c1389 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.608882:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ae00/0x64919c0f856c1389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.608894:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ae00/0x64919c0f856c1389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.608951:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b000/0x64919c0f856c137b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.608960:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b000/0x64919c0f856c137b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.608967:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b000/0x64919c0f856c137b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.608974:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bee11b000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545751.608979:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b000/0x64919c0f856c137b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.609006:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b000/0x64919c0f856c137b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.609022:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:3.0:1789545751.609026:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545751.609032:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b000/0x64919c0f856c137b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.609039:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b000/0x64919c0f856c137b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789545751.609055:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000407f5af reply state 00000000e3742784 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11be00/0x64919c0f856c1382 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545751.609064:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789545751.609105:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ba00/0x64919c0f856c1374 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de570c expref: 39 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.609121:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ae00/0x64919c0f856c1389 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de570c expref: 38 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.609129:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f9e000) 00010000:00010000:3.0:1789545751.609132:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789545751.609134:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bee11ae00, rc 0) 00000100:00100000:3.0:1789545751.609425:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+39:11605:x1876474438176768:12345-192.168.201.16@tcp:101:bash.0 Request processed in 2879us (3330us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1789545751.609435:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 198 00000100:00100000:2.0:1789545751.613630:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545751.614314:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438176896 00000100:00100000:3.0:1789545751.614329:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438176896 00000100:00080000:2.0:1789545751.614456:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789545751.614486:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 59 00000100:00100000:3.0:1789545751.614502:0:8211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a8edb7a-f384-4468-93f4-9d664f284862+5:2358:x1876474438176896:12345-192.168.201.16@tcp:101:bash.0 00010000:00010000:3.0:1789545751.614539:0:8211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545751.614572:0:8211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d8afb8a/0x64919c0f856c1397 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5713 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789545751.614617:0:8211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789545751.614653:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=365s v=(0 0) 00010000:00010000:3.0:1789545751.614659:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789545751.614671:0:8211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d8afb8a/0x64919c0f856c1397 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5713 expref: 6 pid: 8211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.614692:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11be00/0x64919c0f856c1382 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.614694:0:8211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003d8afb8a/0x64919c0f856c1397 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5713 expref: 6 pid: 8211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.614704:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11be00/0x64919c0f856c1382 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.614713:0:8211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bee11aa00, rc 0) 00010000:00010000:1.0:1789545751.614920:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11be00/0x64919c0f856c1382 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.614927:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bee11be00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545751.614933:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11be00/0x64919c0f856c1382 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.614942:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11be00/0x64919c0f856c1382 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.614960:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994bc4f9e100) 00000100:00100000:3.0:1789545751.614961:0:8211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a8edb7a-f384-4468-93f4-9d664f284862+6:2358:x1876474438176896:12345-192.168.201.16@tcp:101:bash.0 Request processed in 464us (1344us total) trans 0 rc 0/0 00010000:00010000:1.0:1789545751.614963:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545751.614969:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11be00/0x64919c0f856c1382 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545751.614970:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 59 00010000:00010000:1.0:1789545751.614975:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11be00/0x64919c0f856c1382 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545751.618100:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545751.618290:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438177024 00000100:00100000:3.0:1789545751.618304:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438177024 00000100:00100000:3.0:1789545751.618405:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 60 00000100:00100000:3.0:1789545751.618418:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+6:11605:x1876474438177024:12345-192.168.201.16@tcp:101:bash.0 00010000:00010000:3.0:1789545751.618442:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545751.618468:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6691ad1/0x64919c0f856c139e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de571a expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.618777:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003d8afb8a/0x64919c0f856c1397 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5713 expref: 7 pid: 8211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.618788:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789545751.618793:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789545751.618799:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6691ad1/0x64919c0f856c139e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de571a expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.618846:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003d8afb8a/0x64919c0f856c1397 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5713 expref: 7 pid: 8211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.618862:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003d8afb8a/0x64919c0f856c1397 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5713 expref: 7 pid: 8211 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545751.618879:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb1b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6693:1876474454946048:192.168.201.16@tcp:104: 00000100:00100000:3.0:1789545751.619065:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8db1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789545751.627989:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545751.628099:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438177152 00000100:00100000:1.0:1789545751.628114:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438177152 00010000:00010000:1.0:1789545751.628171:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003d8afb8a/0x64919c0f856c1397 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5713 expref: 8 pid: 8211 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545751.628223:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 76 00000100:00100000:1.0:1789545751.628234:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd9364050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+8:2359:x1876474438177152:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789545751.628262:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545751.628289:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003d8afb8a/0x64919c0f856c1397 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5713 expref: 8 pid: 8211 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.628327:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003d8afb8a/0x64919c0f856c1397 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5713 expref: 8 pid: 8211 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.628399:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789545751.628406:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789545751.628418:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6691ad1/0x64919c0f856c139e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de571a expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.628430:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6691ad1/0x64919c0f856c139e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de571a expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.628487:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b6691ad1/0x64919c0f856c139e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de571a expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545751.628515:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5833:1876474454946176:192.168.201.16@tcp:105: 00000100:00100000:1.0:1789545751.628630:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc640c0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789545751.631938:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d8afb8a/0x64919c0f856c1397 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5713 expref: 8 pid: 8211 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545751.631972:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb1b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6693:1876474454946048:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545751.632015:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b6691ad1/0x64919c0f856c139e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de571a expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.632033:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bee11ba00, rc 0) 00000100:00100000:2.0:1789545751.632824:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a8edb7a-f384-4468-93f4-9d664f284862+7:11605:x1876474438177024:12345-192.168.201.16@tcp:101:bash.0 Request processed in 14397us (14729us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545751.632839:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 60 00000100:00100000:0.0:1789545751.636269:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545751.636457:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438177408 00000100:00100000:3.0:1789545751.636471:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438177408 00000100:00100000:3.0:1789545751.636547:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 55 00000100:00100000:3.0:1789545751.636559:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+38:11605:x1876474438177408:12345-192.168.201.16@tcp:35:bash.0 00000100:00100000:3.0:1789545751.637176:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+39:11605:x1876474438177408:12345-192.168.201.16@tcp:35:bash.0 Request processed in 616us (917us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1789545751.637186:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 55 00000100:00100000:2.0:1789545751.639172:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5833:1876474454946176:192.168.201.16@tcp:105: 00010000:00010000:2.0:1789545751.639232:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789545751.639384:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd9364050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+6:2359:x1876474438177152:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 11150us (11409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545751.639397:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 76 00000100:00100000:0.0:1789545751.804841:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545751.805015:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438177536 00000100:00100000:3.0:1789545751.805029:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438177536 00000100:00100000:3.0:1789545751.805103:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 199 00000100:00100000:3.0:1789545751.805115:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+39:11621:x1876474438177536:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:3.0:1789545751.805145:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545751.805173:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11aa00/0x64919c0f856c13a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5721 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.805263:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b000/0x64919c0f856c13ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.805282:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b000/0x64919c0f856c13ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.805294:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b000/0x64919c0f856c13ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545751.805340:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789545751.805345:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789545751.805441:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b000/0x64919c0f856c13ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.805671:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11aa00/0x64919c0f856c13a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5721 expref: 41 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.805697:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b000/0x64919c0f856c13ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5721 expref: 40 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.805718:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:3.0:1789545751.805723:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789545751.805728:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bee11b000, rc 0) 00000100:00100000:3.0:1789545751.805816:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+40:11621:x1876474438177536:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 701us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545751.805824:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 199 00000100:00100000:0.0:1789545751.811994:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545751.812155:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438177792 00000100:00100000:3.0:1789545751.812170:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438177792 00000100:00100000:3.0:1789545751.812244:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 200 00000100:00100000:3.0:1789545751.812257:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be549b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+40:11621:x1876474438177792:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:3.0:1789545751.812284:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545751.812308:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11aa00/0x64919c0f856c13b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5728 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.812475:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a000/0x64919c0f856c13ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.812617:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a000/0x64919c0f856c13ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.812633:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a000/0x64919c0f856c13ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545751.812667:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789545751.812848:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11aa00/0x64919c0f856c13b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5728 expref: 43 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.812870:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a000/0x64919c0f856c13ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5728 expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.812881:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f9e000) 00010000:00010000:3.0:1789545751.812883:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789545751.812888:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bee11a000, rc 0) 00000100:00100000:3.0:1789545751.813024:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be549b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+42:11621:x1876474438177792:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 769us (1045us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1789545751.813031:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 200 00000100:00100000:1.0:1789545751.817706:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545751.817771:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545751.817875:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438178176 00000100:00100000:2.0:1789545751.817890:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438178176 00000100:00100000:2.0:1789545751.817988:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 14 00000100:00100000:2.0:1789545751.818001:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a8edb7a-f384-4468-93f4-9d664f284862+42:2359:x1876474438178176:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789545751.818021:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545751.818053:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a000/0x64919c0f856c13ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5728 expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545751.818076:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f9e000) 00010000:00010000:2.0:1789545751.818083:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789545751.818163:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a8edb7a-f384-4468-93f4-9d664f284862+41:2359:x1876474438178176:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 164us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545751.818172:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 14 00000100:00100000:0.0:1789545751.818253:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438178048 00000100:00100000:0.0:1789545751.818258:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438178048 00000100:00100000:0.0:1789545751.818303:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 201 00000100:00100000:0.0:1789545751.818312:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+41:11621:x1876474438178048:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:0.0:1789545751.818339:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545751.818390:0:10125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c13c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de572f expref: -99 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.819385:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c13cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.819412:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c13cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.819437:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c13cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789545751.819453:0:10125:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789545751.819834:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c13c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de572f expref: 44 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.819858:0:10125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c13cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de572f expref: 43 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.819866:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f9e000) 00010000:00010000:0.0:1789545751.819869:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789545751.819872:0:10125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb6600, rc 0) 00000100:00100000:0.0:1789545751.819954:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+43:11621:x1876474438178048:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 1643us (2264us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1789545751.819963:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 201 00000100:00100000:0.0:1789545751.827085:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545751.827199:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438178304 00000100:00100000:1.0:1789545751.827213:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438178304 00000100:00100000:1.0:1789545751.827278:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 61 00000100:00100000:1.0:1789545751.827287:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+6:2360:x1876474438178304:12345-192.168.201.16@tcp:1:lfs.0 00010000:00010000:1.0:1789545751.827340:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c06dd9d/0x64919c0f856c13dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.827420:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6691ad1/0x64919c0f856c139e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de571a expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.827428:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789545751.827432:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789545751.827436:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c06dd9d/0x64919c0f856c13dd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.827473:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b6691ad1/0x64919c0f856c139e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de571a expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.827485:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b6691ad1/0x64919c0f856c139e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de571a expref: 6 pid: 6693 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545751.827677:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876474454946304:192.168.201.16@tcp:104: 00000100:00100000:1.0:1789545751.827787:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc640ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1789545751.831231:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545751.831314:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438178432 00000100:00100000:3.0:1789545751.831326:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438178432 00002000:00100000:3.0:1789545751.831422:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff994be5498700 x1876474438178432/t0(0) o4->8a8edb7a-f384-4468-93f4-9d664f284862@192.168.201.16@tcp:217/0 lens 504/0 e 0 to 0 dl 1789545762 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789545751.831431:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994be5498700 with x1876474438178432 ext(0->8) 00010000:00010000:3.0:1789545751.831441:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b6691ad1/0x64919c0f856c139e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de571a expref: 7 pid: 6693 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.831456:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b6691ad1/0x64919c0f856c139e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de571a expref: 7 pid: 6693 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789545751.831463:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff994be5498700 00000100:00100000:3.0:1789545751.831487:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3 00000100:00100000:3.0:1789545751.831524:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5498700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8a8edb7a-f384-4468-93f4-9d664f284862+7:2359:x1876474438178432:12345-192.168.201.16@tcp:4:lfs.0 00000100:00100000:1.0:1789545751.832163:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876474454946304:192.168.201.16@tcp:104: 00010000:00010000:1.0:1789545751.832200:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008c06dd9d/0x64919c0f856c13dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545751.832285:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5498700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8a8edb7a-f384-4468-93f4-9d664f284862+9:2359:x1876474438178432:12345-192.168.201.16@tcp:4:lfs.0 Request processed in 762us (1065us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789545751.832294:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3 00002000:00100000:3.0:1789545751.832304:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff994be5498700 x1876474438178432/t4294967308(0) o4->8a8edb7a-f384-4468-93f4-9d664f284862@192.168.201.16@tcp:217/0 lens 504/448 e 0 to 0 dl 1789545762 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789545751.832314:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994be5498700 with x1876474438178432 ext(0->8) 00010000:00010000:3.0:1789545751.832321:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b6691ad1/0x64919c0f856c139e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de571a expref: 9 pid: 6693 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.832335:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b6691ad1/0x64919c0f856c139e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de571a expref: 9 pid: 6693 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789545751.832340:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff994be5498700 00000100:00100000:3.0:1789545751.834316:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545751.834442:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438178560 00000100:00100000:0.0:1789545751.834456:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438178560 00010000:00010000:0.0:1789545751.834570:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b6691ad1/0x64919c0f856c139e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de571a expref: 9 pid: 6693 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545751.834624:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 77 00000100:00100000:0.0:1789545751.834636:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a8edb7a-f384-4468-93f4-9d664f284862+9:2361:x1876474438178560:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789545751.834659:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789545751.834705:0:7636:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789545751.834709:0:7636:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789545752 00002000:00010000:0.0:1789545751.834712:0:7636:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789545752 00002000:00010000:0.0:1789545751.834714:0:7636:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789545752 00010000:00010000:0.0:1789545751.834722:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b6691ad1/0x64919c0f856c139e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de571a expref: 9 pid: 6693 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.834738:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b6691ad1/0x64919c0f856c139e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de571a expref: 9 pid: 6693 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.834769:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6691ad1/0x64919c0f856c139e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de571a expref: 9 pid: 6693 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.834793:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789545751.834798:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789545751.834804:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008c06dd9d/0x64919c0f856c13dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.834816:0:7636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c06dd9d/0x64919c0f856c13dd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.834861:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789545751.835032:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008c06dd9d/0x64919c0f856c13dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.835044:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c06dd9d/0x64919c0f856c13dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.835084:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c06dd9d/0x64919c0f856c13dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.835093:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c06dd9d/0x64919c0f856c13dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.835103:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c06dd9d/0x64919c0f856c13dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.835111:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba9c00 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:1.0:1789545751.835116:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c06dd9d/0x64919c0f856c13dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.835126:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c06dd9d/0x64919c0f856c13dd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.835140:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c06dd9d/0x64919c0f856c13dd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.835148:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c06dd9d/0x64919c0f856c13dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545751.835230:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a8edb7a-f384-4468-93f4-9d664f284862+8:2361:x1876474438178560:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 594us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545751.835241:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 77 00000100:00100000:1.0:1789545751.835643:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+7:2360:x1876474438178304:12345-192.168.201.16@tcp:1:lfs.0 Request processed in 8354us (8568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545751.835654:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 61 00000100:00100000:2.0:1789545751.838998:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545751.839147:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438178816 00000100:00100000:3.0:1789545751.839162:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438178816 00000100:00100000:3.0:1789545751.839235:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 56 00000100:00100000:3.0:1789545751.839247:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8cc6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+43:11621:x1876474438178816:12345-192.168.201.16@tcp:35:lfs.0 00000004:00010000:3.0:1789545751.839333:0:5850:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c13cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de572f expref: 43 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789545751.841106:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1789545751.841167:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1789545751.842115:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1789545751.842218:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c13e4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545751.842246:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ae00/0x64919c0f856c1389 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de570c expref: 47 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545751.842257:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c13e4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545751.842332:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ae00/0x64919c0f856c1389 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de570c expref: 47 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545751.842349:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ae00/0x64919c0f856c1389 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de570c expref: 47 pid: 5848 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545751.842396:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994becd93480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5850:1876474454946432:192.168.201.16@tcp:104: 00000100:00100000:2.0:1789545751.842971:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bedd78300 going to sleep for 11 seconds 00000100:00100000:2.0:1789545751.848284:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545751.848817:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438178944 00000100:00100000:3.0:1789545751.848831:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438178944 00010000:00010000:3.0:1789545751.848893:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ae00/0x64919c0f856c1389 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de570c expref: 48 pid: 5848 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545751.849035:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 78 00000100:00100000:3.0:1789545751.849048:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+48:2358:x1876474438178944:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789545751.849069:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545751.849078:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ae00/0x64919c0f856c1389 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de570c expref: 48 pid: 5848 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.849093:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ae00/0x64919c0f856c1389 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de570c expref: 48 pid: 5848 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545751.849108:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994becd93480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5850:1876474454946432:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545751.849120:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ae00/0x64919c0f856c1389 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de570c expref: 48 pid: 5848 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.849137:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c13e4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.849151:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f9e000) 00010000:00010000:3.0:1789545751.849156:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c13e4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.849166:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c13e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.849175:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c13e4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545751.849243:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545751.849325:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+47:2358:x1876474438178944:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 278us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545751.849335:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 78 00010000:00010000:1.0:1789545751.850835:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c13e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.850851:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c13e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789545751.851031:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1789545751.851404:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1789545751.852023:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1876474454946560:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789545751.852111:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545751.852262:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454946560 00000100:00100000:2.0:1789545751.852271:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454946560 00000100:00100000:2.0:1789545751.852382:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789545751.852394:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1876474454946560:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1789545751.852657:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789545751.852829:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1876474454946560:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 436us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545751.852838:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789545751.853295:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc611f540 going to sleep for 11 seconds 00000100:00100000:1.0:1789545751.853337:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1876474454946560:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789545751.854350:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1789545751.855027:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1876474454946688:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789545751.855108:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545751.855289:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc644b600 going to sleep for 11 seconds 00000100:00100000:3.0:1789545751.855346:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454946688 00000100:00100000:3.0:1789545751.855697:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454946688 00000100:00100000:3.0:1789545751.855831:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789545751.855842:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5850:x1876474454946688:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789545751.856321:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5850:x1876474454946688:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 479us (1212us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789545751.856331:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789545751.856682:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1876474454946688:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789545751.856851:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1789545751.856947:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c13e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.856960:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c13e4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.856969:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c13e4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.856989:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545751.856995:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c13e4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.857004:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c13e4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.857025:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f9e000) 00010000:00010000:1.0:1789545751.857028:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789545751.857034:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c13e4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.857040:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c13e4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789545751.857783:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789545751.857936:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1789545751.857951:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 365780590597ns, next at 366780587779ns, rc = 0 00000001:00080000:1.0:1789545751.857960:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1789545751.858022:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f9e000) 00010000:00010000:1.0:1789545751.858026:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789545751.858036:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c13cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de572f expref: 51 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545751.858348:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8cc6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+50:11621:x1876474438178816:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 19102us (19362us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1789545751.858406:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 56 00000020:00080000:1.0:1789545751.858413:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789545751.862313:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545751.862697:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438179072 00000100:00100000:0.0:1789545751.862782:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438179072 00000100:00100000:0.0:1789545751.862924:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 202 00000100:00100000:0.0:1789545751.862939:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+50:11621:x1876474438179072:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:0.0:1789545751.862970:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545751.863002:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c13eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5736 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.863081:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c13eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5736 expref: 51 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.863099:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c13eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5736 expref: 51 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545751.863125:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f11b00) 00010000:00010000:0.0:1789545751.863129:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789545751.863146:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb7000, rc 0) 00000100:00100000:0.0:1789545751.863235:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+51:11621:x1876474438179072:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 300us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545751.863243:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 202 00000100:00100000:2.0:1789545751.868429:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545751.868547:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438179328 00000100:00100000:3.0:1789545751.868562:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438179328 00000100:00100000:3.0:1789545751.868633:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 57 00000100:00100000:3.0:1789545751.868645:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+51:11621:x1876474438179328:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:3.0:1789545751.868982:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+52:11621:x1876474438179328:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 338us (570us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1789545751.868993:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 57 00000100:00100000:2.0:1789545751.978247:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545751.978803:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438179456 00000100:00100000:0.0:1789545751.978818:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438179456 00000100:00100000:1.0:1789545751.979033:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 203 00000100:00100000:1.0:1789545751.979047:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+52:11631:x1876474438179456:12345-192.168.201.16@tcp:34:lfs.0 00010000:00010000:1.0:1789545751.979238:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c13f2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.979261:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c13f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.979274:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c13f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.979292:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c13f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.979299:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c13f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.979305:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c13f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.979449:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c1400 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.979458:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c1400 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.979465:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c1400 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789545751.979862:0:10125:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c1400 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.979879:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c13f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.979916:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c13f2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.979924:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c13f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.979931:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba9c00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545751.979936:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c13f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.979946:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c13f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.979961:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:1.0:1789545751.979965:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545751.979971:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c13f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.979977:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c13f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.979993:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c13f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.979999:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c13f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.980007:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c13f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.980012:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba8400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545751.980022:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c13f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.980029:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c13f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.980037:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994bc4ffed00) 00010000:00010000:1.0:1789545751.980040:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545751.980043:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c13f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.980049:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c13f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.980068:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c1400 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.980073:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c1400 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.980079:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c1400 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.980084:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba9000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545751.980086:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c1400 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.980092:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c1400 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.980100:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f11b00) 00010000:00010000:1.0:1789545751.980103:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545751.980112:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c1400 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545751.980119:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9000/0x64919c0f856c1400 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545751.980353:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+52:11631:x1876474438179456:12345-192.168.201.16@tcp:34:lfs.0 Request processed in 1304us (2122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545751.980421:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 203 00000100:00100000:2.0:1789545752.026261:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545752.026439:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438179712 00000100:00100000:3.0:1789545752.026454:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438179712 00000100:00100000:3.0:1789545752.026838:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 204 00000100:00100000:3.0:1789545752.026853:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+52:11634:x1876474438179712:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:3.0:1789545752.026884:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545752.026922:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ae00/0x64919c0f856c1407 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de573d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.027022:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11aa00/0x64919c0f856c140e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.027042:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11aa00/0x64919c0f856c140e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.027057:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11aa00/0x64919c0f856c140e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.027096:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ac00/0x64919c0f856c1415 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.027105:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ac00/0x64919c0f856c1415 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.027112:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ac00/0x64919c0f856c1415 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.027284:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b200/0x64919c0f856c141c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.027294:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b200/0x64919c0f856c141c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.027302:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b200/0x64919c0f856c141c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545752.027314:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789545752.027894:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11aa00/0x64919c0f856c140e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.027916:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11aa00/0x64919c0f856c140e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.027925:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11aa00/0x64919c0f856c140e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.027933:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bee11aa00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545752.027940:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11aa00/0x64919c0f856c140e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.027966:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11aa00/0x64919c0f856c140e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.027983:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:3.0:1789545752.027987:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545752.027994:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11aa00/0x64919c0f856c140e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.028001:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11aa00/0x64919c0f856c140e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.028020:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ac00/0x64919c0f856c1415 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.028027:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ac00/0x64919c0f856c1415 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.028034:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ac00/0x64919c0f856c1415 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.028040:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bee11ac00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545752.028044:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ac00/0x64919c0f856c1415 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.028050:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ac00/0x64919c0f856c1415 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.028058:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994bc4f9eb00) 00010000:00010000:3.0:1789545752.028060:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545752.028063:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ac00/0x64919c0f856c1415 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.028080:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ac00/0x64919c0f856c1415 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.028141:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ae00/0x64919c0f856c1407 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de573d expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.028156:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b200/0x64919c0f856c141c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de573d expref: 54 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.028163:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f11b00) 00010000:00010000:3.0:1789545752.028165:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789545752.028168:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bee11b200, rc 0) 00000100:00100000:3.0:1789545752.028269:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+54:11634:x1876474438179712:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 1419us (2021us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1789545752.028279:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 204 00000100:00100000:3.0:1789545752.033865:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545752.033977:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438179840 00000100:00100000:0.0:1789545752.033992:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438179840 00000100:00100000:0.0:1789545752.034069:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 205 00000100:00100000:0.0:1789545752.034082:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+54:11634:x1876474438179840:12345-192.168.201.16@tcp:54:lfs.0 00010000:00010000:0.0:1789545752.034187:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c142a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545752.034210:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c142a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545752.034244:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c142a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545752.034278:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c142a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545752.034286:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c142a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545752.034294:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c142a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545752.034300:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545752.034304:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c142a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545752.034313:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c142a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545752.034327:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f11b00) 00010000:00010000:0.0:1789545752.034331:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789545752.034337:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c142a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545752.034344:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c142a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545752.034477:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+54:11634:x1876474438179840:12345-192.168.201.16@tcp:54:lfs.0 Request processed in 398us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545752.034747:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 205 00000100:00100000:0.0:1789545752.037350:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545752.037694:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438180096 00000100:00100000:3.0:1789545752.037789:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438180096 00000100:00100000:3.0:1789545752.037858:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 58 00000100:00100000:3.0:1789545752.037871:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+54:11634:x1876474438180096:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:3.0:1789545752.038220:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+55:11634:x1876474438180096:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 349us (881us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1789545752.038229:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 58 00000100:00100000:3.0:1789545752.118604:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545752.118755:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438180352 00000100:00100000:0.0:1789545752.118769:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438180352 00000100:00100000:0.0:1789545752.118848:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 206 00000100:00100000:0.0:1789545752.118860:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+55:11644:x1876474438180352:12345-192.168.201.16@tcp:101:bash.0 00010000:00010000:0.0:1789545752.118896:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545752.118912:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789545752.118952:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b000/0x64919c0f856c13ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5721 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545752.118975:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:0.0:1789545752.118981:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789545752.118997:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c1431 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5744 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545752.119120:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c1438 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545752.119148:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b200/0x64919c0f856c141c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de573d expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545752.119158:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c1438 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545752.119202:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b200/0x64919c0f856c141c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de573d expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545752.119217:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b200/0x64919c0f856c141c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de573d expref: 55 pid: 5846 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545752.119260:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be549b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1876474454946816:192.168.201.16@tcp:104: 00000100:00100000:0.0:1789545752.119447:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd938cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789545752.123965:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be549b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1876474454946816:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545752.124010:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c1438 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545752.124777:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545752.124857:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438180480 00000100:00100000:1.0:1789545752.124867:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438180480 00010000:00010000:1.0:1789545752.124927:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b200/0x64919c0f856c141c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de573d expref: 56 pid: 5846 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545752.124967:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 79 00000100:00100000:1.0:1789545752.124978:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+56:2359:x1876474438180480:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789545752.124996:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545752.125004:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b200/0x64919c0f856c141c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de573d expref: 56 pid: 5846 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545752.125018:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b200/0x64919c0f856c141c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de573d expref: 56 pid: 5846 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545752.125044:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b200/0x64919c0f856c141c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de573d expref: 56 pid: 5846 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545752.125063:0:7637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f11b00) 00010000:00010000:1.0:1789545752.125068:0:7637:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c1438 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545752.125094:0:7637:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c1438 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545752.125102:0:7637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c1438 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545752.125139:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789545752.125209:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+55:2359:x1876474438180480:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 232us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545752.125218:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 79 00010000:00010000:3.0:1789545752.126310:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c1438 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.126324:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c1438 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545752.126353:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789545752.126890:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c1431 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5744 expref: 56 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.126927:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c1438 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5744 expref: 55 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.126938:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f11b00) 00010000:00010000:3.0:1789545752.126942:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789545752.126946:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb6800, rc 0) 00000100:00100000:3.0:1789545752.127023:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+55:11644:x1876474438180352:12345-192.168.201.16@tcp:101:bash.0 Request processed in 8164us (8434us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1789545752.127033:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 206 00000100:00100000:3.0:1789545752.130886:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545752.130993:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438180736 00000100:00100000:1.0:1789545752.131007:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438180736 00000100:00100000:1.0:1789545752.131084:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 207 00000100:00100000:1.0:1789545752.131097:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+55:11644:x1876474438180736:12345-192.168.201.16@tcp:36:bash.0 00010000:00010000:1.0:1789545752.131498:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c1446 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545752.131803:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c1446 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545752.131821:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c1446 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789545752.131891:0:10125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1789545752.131933:0:10125:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f39d304 reply state 00000000f83bf05e transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c1446 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545752.131943:0:10125:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789545752.132109:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+58:11644:x1876474438180736:12345-192.168.201.16@tcp:36:bash.0 Request processed in 1013us (1235us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1789545752.132148:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 207 00000020:00080000:1.0:1789545752.132155:0:10125:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789545752.137172:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545752.137343:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438180864 00000100:00100000:0.0:1789545752.137401:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438180864 00000100:00100000:0.0:1789545752.137478:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 208 00000100:00100000:0.0:1789545752.137691:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+58:11644:x1876474438180864:12345-192.168.201.16@tcp:101:bash.0 00010000:00010000:0.0:1789545752.137733:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545752.137759:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c144d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de574b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545752.137870:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c1454 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545752.137889:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c1438 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5744 expref: 59 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545752.137913:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c1446 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545752.137922:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c1454 lrc: 5/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545752.137946:0:5846:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c1446 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545752.137978:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c1438 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5744 expref: 59 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545752.138014:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c1438 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5744 expref: 59 pid: 5848 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545752.138030:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be5498e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876474454946944:192.168.201.16@tcp:104: 00000100:00100000:0.0:1789545752.138190:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd938cd80 going to sleep for 11 seconds 00010000:00010000:3.0:1789545752.138617:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c1446 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.138627:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c1446 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.138634:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c1446 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.138649:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba8400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545752.138653:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c1446 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.138662:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c1446 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.138680:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f11b00) 00010000:00010000:3.0:1789545752.138683:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545752.138686:0:3298:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c1454 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.138697:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c1446 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.138802:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8400/0x64919c0f856c1446 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545752.142823:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545752.142985:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be5498e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876474454946944:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545752.143023:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c1454 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545752.143079:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438180992 00000100:00100000:1.0:1789545752.143088:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438180992 00010000:00010000:1.0:1789545752.143203:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c1438 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5744 expref: 59 pid: 5848 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545752.143299:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 80 00000100:00100000:1.0:1789545752.143311:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be549ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a8edb7a-f384-4468-93f4-9d664f284862+59:2358:x1876474438180992:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789545752.143332:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545752.143340:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c1438 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5744 expref: 59 pid: 5848 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545752.143355:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c1438 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5744 expref: 59 pid: 5848 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545752.143416:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c1438 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5744 expref: 59 pid: 5848 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545752.143435:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f11b00) 00010000:00010000:1.0:1789545752.143440:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c1454 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545752.143450:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c1454 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545752.143458:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c1454 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545752.143631:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789545752.143758:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c1454 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.143766:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c1454 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545752.143829:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789545752.143835:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789545752.143871:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c1454 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.143919:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c144d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de574b expref: 59 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.143936:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c1454 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de574b expref: 58 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.143945:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f11b00) 00010000:00010000:3.0:1789545752.143947:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789545752.143950:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb6600, rc 0) 00000100:00100000:1.0:1789545752.144056:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be549ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a8edb7a-f384-4468-93f4-9d664f284862+58:2358:x1876474438180992:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 746us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545752.144065:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 80 00000100:00100000:3.0:1789545752.144858:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+57:11644:x1876474438180864:12345-192.168.201.16@tcp:101:bash.0 Request processed in 7366us (7695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545752.144869:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 208 00000100:00100000:2.0:1789545752.151631:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545752.151893:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438181248 00000100:00100000:3.0:1789545752.151917:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438181248 00000100:00100000:3.0:1789545752.152024:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 59 00000100:00100000:3.0:1789545752.152036:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994becd93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+57:11644:x1876474438181248:12345-192.168.201.16@tcp:35:bash.0 00000100:00100000:3.0:1789545752.152401:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994becd93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+58:11644:x1876474438181248:12345-192.168.201.16@tcp:35:bash.0 Request processed in 328us (747us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1789545752.152411:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 59 00000100:00100000:0.0:1789545752.228289:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545752.228867:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438181376 00000100:00100000:2.0:1789545752.228883:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438181376 00000100:00100000:2.0:1789545752.229038:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 209 00000100:00100000:2.0:1789545752.229052:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+58:11650:x1876474438181376:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:2.0:1789545752.229086:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545752.229145:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c145b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5752 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.229239:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1462 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.229258:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.229272:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545752.229319:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789545752.229324:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789545752.229346:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.229431:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c145b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5752 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.229456:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1462 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5752 expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.229466:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:2.0:1789545752.229469:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789545752.229475:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1c00, rc 0) 00000100:00100000:2.0:1789545752.229921:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+59:11650:x1876474438181376:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 870us (1645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545752.229930:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 209 00000100:00100000:0.0:1789545752.234195:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545752.235015:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438181504 00000100:00100000:1.0:1789545752.235033:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438181504 00000100:00100000:2.0:1789545752.235119:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 210 00000100:00100000:2.0:1789545752.235161:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be549b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+59:11650:x1876474438181504:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:2.0:1789545752.235190:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545752.235216:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c1469 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5759 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.235307:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1470 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.235326:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1470 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.235339:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1470 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.235356:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c1477 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.235398:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c1477 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.235404:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c1477 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.235749:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c147e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.235761:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c147e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.235768:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c147e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545752.235826:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789545752.235831:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789545752.235855:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c147e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.235870:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c147e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.235880:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1470 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.235887:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1470 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.235894:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1470 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.235912:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545752.235917:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1470 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.235926:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1470 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.235941:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:2.0:1789545752.235944:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545752.235950:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1470 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.235958:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0400/0x64919c0f856c1470 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.235989:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c1477 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.235996:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c1477 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.236002:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c1477 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.236007:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545752.236010:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c1477 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.236016:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c1477 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.236024:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994bcd248500) 00010000:00010000:2.0:1789545752.236026:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545752.236029:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c1477 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.236035:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c1477 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.236075:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c1469 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5759 expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.236090:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c147e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5759 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545752.236109:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f11b00) 00010000:00010000:2.0:1789545752.236111:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789545752.236114:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1200, rc 0) 00000100:00100000:2.0:1789545752.236210:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be549b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+60:11650:x1876474438181504:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 1053us (2029us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545752.236220:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 210 00000100:00100000:2.0:1789545752.242125:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545752.242171:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545752.242248:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438181760 00000100:00100000:3.0:1789545752.242262:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438181760 00000100:00100000:3.0:1789545752.242340:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 211 00000100:00100000:3.0:1789545752.242352:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf5d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+60:11650:x1876474438181760:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:3.0:1789545752.242407:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545752.242453:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ae00/0x64919c0f856c1485 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5760 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.242610:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ac00/0x64919c0f856c148c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.242628:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c1454 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de574b expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.242637:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c147e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5759 expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.242645:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ac00/0x64919c0f856c148c lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.242691:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c147e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5759 expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.242706:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c147e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5759 expref: 61 pid: 5847 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545752.242723:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be76d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1876474454947072:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545752.242849:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c1454 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de574b expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.242858:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c1454 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de574b expref: 61 pid: 5846 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545752.242867:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be76d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1876474454947200:192.168.201.16@tcp:104: 00000100:00100000:3.0:1789545752.242896:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8db1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789545752.243459:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438181888 00000100:00100000:0.0:1789545752.243468:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438181888 00010000:00010000:0.0:1789545752.243522:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c147e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5759 expref: 62 pid: 5847 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545752.243558:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 81 00000100:00100000:0.0:1789545752.243569:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+62:2359:x1876474438181888:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789545752.243582:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789545752.243590:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c147e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5759 expref: 62 pid: 5847 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545752.243603:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c147e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5759 expref: 62 pid: 5847 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545752.243625:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f11b00) 00010000:00010000:0.0:1789545752.243631:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ac00/0x64919c0f856c148c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545752.243651:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ac00/0x64919c0f856c148c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545752.243660:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789545752.243711:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+62:2359:x1876474438181888:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 144us (1538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545752.243720:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 81 00010000:00010000:3.0:1789545752.249897:0:5848:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.16@tcp) returned -22 from blocking AST (req@00000000f6dbb776 x1876474454947072) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c147e lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5759 expref: 61 pid: 5847 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.249941:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c147e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5759 expref: 61 pid: 5847 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545752.249964:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be76d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1876474454947072:192.168.201.16@tcp:104: 00000100:00100000:3.0:1789545752.249983:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be76d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1876474454947200:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545752.250012:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f11b00) 00010000:00010000:3.0:1789545752.250019:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ac00/0x64919c0f856c148c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.250031:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ac00/0x64919c0f856c148c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.250043:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ac00/0x64919c0f856c148c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545752.250301:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545752.250409:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438182016 00000100:00100000:1.0:1789545752.250420:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438182016 00010000:00010000:1.0:1789545752.250468:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c1454 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de574b expref: 61 pid: 5846 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545752.250531:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 82 00000100:00100000:1.0:1789545752.250542:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd9364850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a8edb7a-f384-4468-93f4-9d664f284862+61:2358:x1876474438182016:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789545752.250561:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545752.250568:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c1454 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de574b expref: 61 pid: 5846 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545752.250582:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c1454 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de574b expref: 61 pid: 5846 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545752.250607:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c1454 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de574b expref: 61 pid: 5846 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545752.250621:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f11b00) 00010000:00010000:1.0:1789545752.250625:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ac00/0x64919c0f856c148c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545752.250657:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ac00/0x64919c0f856c148c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545752.250666:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ac00/0x64919c0f856c148c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545752.250695:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789545752.250769:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd9364850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a8edb7a-f384-4468-93f4-9d664f284862+60:2358:x1876474438182016:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 228us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545752.250778:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 82 00010000:00010000:3.0:1789545752.251756:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ac00/0x64919c0f856c148c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.251767:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ac00/0x64919c0f856c148c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545752.251792:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789545752.251999:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ae00/0x64919c0f856c1485 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5760 expref: 61 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.252038:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ac00/0x64919c0f856c148c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5760 expref: 60 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.252045:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f11b00) 00010000:00010000:3.0:1789545752.252049:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789545752.252052:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bee11ac00, rc 0) 00000100:00100000:3.0:1789545752.252114:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf5d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+60:11650:x1876474438181760:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 9764us (10001us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1789545752.252123:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 211 00000100:00100000:2.0:1789545752.256951:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545752.257045:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438182272 00000100:00100000:1.0:1789545752.257057:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438182272 00000100:00100000:1.0:1789545752.257137:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 15 00000100:00100000:1.0:1789545752.257152:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf5d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a8edb7a-f384-4468-93f4-9d664f284862+60:11650:x1876474438182272:12345-192.168.201.16@tcp:103:lfs.0 00010000:00010000:1.0:1789545752.257173:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545752.257204:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c13eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5736 expref: 60 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545752.257228:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f11b00) 00010000:00010000:1.0:1789545752.257234:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789545752.257419:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf5d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a8edb7a-f384-4468-93f4-9d664f284862+59:11650:x1876474438182272:12345-192.168.201.16@tcp:103:lfs.0 Request processed in 270us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545752.257428:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 15 00000100:00100000:0.0:1789545752.260092:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545752.260242:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438182400 00000100:00100000:3.0:1789545752.260256:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438182400 00000100:00100000:3.0:1789545752.260343:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 212 00000100:00100000:3.0:1789545752.260356:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be549ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+59:11650:x1876474438182400:12345-192.168.201.16@tcp:58:lfs.0 00010000:00010000:3.0:1789545752.260986:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11aa00/0x64919c0f856c149a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.261010:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11aa00/0x64919c0f856c149a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545752.261025:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11aa00/0x64919c0f856c149a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789545752.261282:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1789545752.262045:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be549ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+59:11650:x1876474438182400:12345-192.168.201.16@tcp:58:lfs.0 Request processed in 1684us (1959us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545752.262058:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 212 00000100:00100000:0.0:1789545752.264837:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545752.264923:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438182528 00000100:00100000:1.0:1789545752.264937:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438182528 00000100:00100000:1.0:1789545752.265010:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 213 00000100:00100000:1.0:1789545752.265022:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+59:11650:x1876474438182528:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:1.0:1789545752.265069:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545752.265094:0:10125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c14a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5767 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545752.265173:0:10125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11aa00/0x64919c0f856c149a lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545752.265187:0:10125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c14a1 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5767 expref: 60 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545752.265211:0:10125:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11aa00/0x64919c0f856c149a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545752.265229:0:10125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c14a1 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5767 expref: 60 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545752.265246:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f11b00) 00010000:00010000:1.0:1789545752.265250:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789545752.265254:0:10125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c14a1 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5767 expref: 60 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545752.265263:0:10125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba9c00, rc 0) 00000100:00100000:1.0:1789545752.265424:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+60:11650:x1876474438182528:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 403us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545752.265433:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 213 00010000:00010000:3.0:1789545752.388414:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789545753.021080:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789545753.021094:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789545753.021140:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1789545753.021155:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789545753.021537:0:11700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c5180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1876474454947328:192.168.201.16@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789545753.021791:0:11700:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc640c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789545753.026726:0:11700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c5180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1876474454947328:192.168.201.16@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789545753.028746:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545753.029347:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438182656 00000100:00100000:1.0:1789545753.029388:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438182656 00000100:00100000:1.0:1789545753.029498:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 214 00000100:00100000:1.0:1789545753.029511:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf5db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+60:11651:x1876474438182656:12345-192.168.201.16@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789545753.029555:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00080000:0.0:1789545753.029778:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789545753.029870:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf5db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+60:11651:x1876474438182656:12345-192.168.201.16@tcp:53:lhsmtool_posix.0 Request processed in 361us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545753.029895:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 214 00000100:00100000:0.0:1789545753.043187:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545753.043518:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438182784 00000100:00100000:1.0:1789545753.043533:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438182784 00000100:00100000:1.0:1789545753.043618:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 215 00000100:00100000:1.0:1789545753.043632:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+60:11651:x1876474438182784:12345-192.168.201.16@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789545753.044068:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c14a8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.044090:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c14a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.044105:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c14a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.044124:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c14af lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.044155:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c14af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.044164:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c14af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.044198:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c14b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.044208:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c14b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.044215:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c14b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789545753.044273:0:10125:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789545753.044278:0:10125:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789545753.044295:0:10125:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c14b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.044308:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c14a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.044316:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c14a8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.044323:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c14a8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.044330:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba8200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545753.044335:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c14a8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.044350:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c14a8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.044406:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff994bc4f11700) 00010000:00010000:1.0:1789545753.044411:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545753.044418:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c14a8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.044424:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c14a8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.044440:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c14af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.044447:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c14af lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.044453:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c14af lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.044458:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba9800 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545753.044461:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c14af lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.045607:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c14af lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.045627:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff994bc4ffed00) 00010000:00010000:1.0:1789545753.045631:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545753.045635:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c14af lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.045661:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c14af lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.045686:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c14b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.045693:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c14b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.045960:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c14b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.045971:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba8800 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545753.045975:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c14b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.045982:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c14b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.045992:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f11b00) 00010000:00010000:1.0:1789545753.045994:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545753.045998:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c14b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.046004:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c14b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545753.046221:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+60:11651:x1876474438182784:12345-192.168.201.16@tcp:34:lhsmtool_posix.0 Request processed in 2586us (3044us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545753.046235:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 215 00000100:00100000:3.0:1789545753.057096:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545753.057353:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438183040 00000100:00100000:1.0:1789545753.057414:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438183040 00000100:00100000:1.0:1789545753.057503:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 216 00000100:00100000:1.0:1789545753.057516:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+60:11651:x1876474438183040:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789545753.057547:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545753.057573:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c14bd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de576e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.057730:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c14c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.057750:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c14c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.057763:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c14c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789545753.057778:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789545753.058164:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c14c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.058175:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c14c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.058184:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c14c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.058191:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba9800 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545753.058196:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c14c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.058206:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c14c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.058238:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f11b00) 00010000:00010000:1.0:1789545753.058242:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789545753.058248:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c14c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.058255:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c14c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.058313:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c14bd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de576e expref: 62 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.058325:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff994bc4f11700) 00010000:00010000:1.0:1789545753.058327:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789545753.058332:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c14bd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de576e expref: 62 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.058343:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba8800, rc 0) 00000100:00100000:1.0:1789545753.058744:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+61:11651:x1876474438183040:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 1227us (1659us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1789545753.058755:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 216 00000100:00100000:2.0:1789545753.066058:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545753.066182:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438183168 00000100:00100000:3.0:1789545753.066197:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438183168 00000100:00100000:3.0:1789545753.066296:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 217 00000100:00100000:3.0:1789545753.066309:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+61:11651:x1876474438183168:12345-192.168.201.16@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789545753.066802:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789545753.067078:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+61:11651:x1876474438183168:12345-192.168.201.16@tcp:53:lhsmtool_posix.0 Request processed in 770us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545753.067088:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 217 00000100:00100000:0.0:1789545753.070607:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545753.070873:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438183424 00000100:00100000:2.0:1789545753.070905:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438183424 00000100:00100000:2.0:1789545753.070980:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 218 00000100:00100000:2.0:1789545753.070993:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf6c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+61:11651:x1876474438183424:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789545753.071028:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545753.071032:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789545753.071070:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1462 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5752 expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.071094:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:2.0:1789545753.071101:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789545753.071118:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c14d2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5775 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789545753.071902:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1789545753.072157:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c14d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.072176:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c14d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.072189:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c14d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.072257:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c14d2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5775 expref: 63 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.072278:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c14d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5775 expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.072287:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff994bcd248500) 00010000:00010000:2.0:1789545753.072291:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789545753.072294:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0c00, rc 0) 00000100:00100000:2.0:1789545753.072435:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf6c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+62:11651:x1876474438183424:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 1443us (1843us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1789545753.072445:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 218 00000100:00100000:2.0:1789545753.078645:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545753.078858:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438183680 00000100:00100000:1.0:1789545753.078873:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438183680 00000100:00100000:1.0:1789545753.079004:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 219 00000100:00100000:1.0:1789545753.079017:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+62:11651:x1876474438183680:12345-192.168.201.16@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789545753.079088:0:10125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545753.079120:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c14d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5775 expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.079151:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff994bcd248500) 00010000:00010000:1.0:1789545753.079162:0:10125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789545753.079186:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c14e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.079200:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c14e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.079208:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c14e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.080949:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c14ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x2574c20 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.080973:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c14ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2574c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.080987:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c14ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2574c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.081066:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c14e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.081074:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c14e7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.081080:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c14e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.081086:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba8800 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545753.081090:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c14e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.081113:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c14e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.081127:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:1.0:1789545753.081129:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545753.081135:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c14e7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.081141:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8800/0x64919c0f856c14e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.081154:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c14ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2574c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.081160:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c14ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2574c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.081167:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c14ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2574c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.081172:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba9800 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545753.081175:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c14ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2574c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.081180:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c14ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2574c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.081186:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x2574c20 (ffff994bc4ffed00) 00010000:00010000:1.0:1789545753.081201:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545753.081205:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c14ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x2574c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.081221:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c14ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x2574c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545753.081336:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+61:11651:x1876474438183680:12345-192.168.201.16@tcp:36:lhsmtool_posix.0 Request processed in 2316us (2701us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789545753.081347:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 219 00000100:00100000:0.0:1789545753.084011:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545753.084160:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438183808 00000100:00100000:2.0:1789545753.084174:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438183808 00000100:00100000:2.0:1789545753.084307:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 220 00000100:00100000:2.0:1789545753.084320:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf6c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+61:11651:x1876474438183808:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789545753.084405:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545753.084436:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c14f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de577c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.084496:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c14fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.084514:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c14fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.084528:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c14fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.084653:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c14f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de577c expref: 63 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.084676:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c14fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de577c expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.084698:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff994bcd248000) 00010000:00010000:2.0:1789545753.084702:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789545753.084706:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1e00, rc 0) 00000100:00100000:2.0:1789545753.084798:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf6c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+62:11651:x1876474438183808:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 480us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545753.084806:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 220 00000100:00100000:0.0:1789545753.088621:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545753.090031:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438184064 00000100:00100000:1.0:1789545753.090055:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438184064 00000100:00100000:1.0:1789545753.090151:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 221 00000100:00100000:1.0:1789545753.090164:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf6c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+62:11651:x1876474438184064:12345-192.168.201.16@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789545753.090288:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1503 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.090310:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1503 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.090324:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1503 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789545753.092050:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1789545753.092071:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 367014710543ns, next at 368014706568ns, rc = 0 00000004:00010000:1.0:1789545753.092204:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005bc6798a reply state 00000000148651d2 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1503 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545753.092220:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789545753.093056:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf6c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+64:11651:x1876474438184064:12345-192.168.201.16@tcp:36:lhsmtool_posix.0 Request processed in 2886us (4443us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1789545753.093069:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 221 00000100:00100000:3.0:1789545753.097793:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:1.0:1789545753.097978:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1503 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.097993:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1503 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.098002:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1503 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.098008:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba8200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545753.098014:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1503 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.098023:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1503 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.098044:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff994bcd248000) 00010000:00010000:1.0:1789545753.098047:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789545753.098053:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1503 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.098060:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1503 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545753.098149:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438184192 00000100:00100000:0.0:1789545753.098163:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438184192 00000100:00100000:0.0:1789545753.098239:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 222 00000100:00100000:0.0:1789545753.098253:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+63:11651:x1876474438184192:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789545753.098288:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545753.098310:0:10125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c150a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5783 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.098434:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c150a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5783 expref: 64 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.098473:0:10125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c150a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5783 expref: 64 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.098498:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff994bcd248000) 00010000:00010000:0.0:1789545753.098501:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789545753.098503:0:10125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb7c00, rc 0) 00000100:00100000:0.0:1789545753.098586:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+64:11651:x1876474438184192:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 336us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545753.098594:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 222 00000100:00100000:0.0:1789545753.103091:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545753.103183:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438184320 00000100:00100000:1.0:1789545753.103197:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438184320 00000100:00100000:1.0:1789545753.103299:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 62 00000100:00100000:1.0:1789545753.103312:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf6c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a8edb7a-f384-4468-93f4-9d664f284862+9:2358:x1876474438184320:12345-192.168.201.16@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789545753.103860:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf6c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a8edb7a-f384-4468-93f4-9d664f284862+10:2358:x1876474438184320:12345-192.168.201.16@tcp:2:lhsmtool_posix.0 Request processed in 548us (784us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1789545753.103871:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 62 00000100:00080000:0.0:1789545753.104142:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789545753.120247:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545753.120447:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438184576 00000100:00100000:1.0:1789545753.120471:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438184576 00000100:00100000:1.0:1789545753.120554:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 60 00000100:00100000:1.0:1789545753.120568:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+64:11651:x1876474438184576:12345-192.168.201.16@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789545753.121200:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+65:11651:x1876474438184576:12345-192.168.201.16@tcp:35:lhsmtool_posix.0 Request processed in 632us (967us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1789545753.121210:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 60 00000100:00100000:3.0:1789545753.125222:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545753.125393:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438184832 00000100:00100000:2.0:1789545753.125406:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438184832 00000100:00100000:2.0:1789545753.125494:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 223 00000100:00100000:2.0:1789545753.125528:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+65:11651:x1876474438184832:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789545753.125694:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+65:11651:x1876474438184832:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 Request processed in 169us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545753.125702:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 223 00000100:00100000:0.0:1789545753.129789:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545753.129984:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438184960 00000100:00100000:1.0:1789545753.129998:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438184960 00000100:00100000:1.0:1789545753.130083:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 224 00000100:00100000:1.0:1789545753.130095:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf6c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+65:11651:x1876474438184960:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789545753.130124:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545753.130151:0:10125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1511 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de578a expref: -99 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.130250:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1518 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.130268:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.130282:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789545753.130330:0:10125:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789545753.130353:0:10125:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.130431:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1511 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de578a expref: 67 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.130474:0:10125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1518 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de578a expref: 66 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.130485:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff994bcd248000) 00010000:00010000:1.0:1789545753.130489:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789545753.130493:0:10125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba9800, rc 0) 00000100:00100000:1.0:1789545753.130578:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf6c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+66:11651:x1876474438184960:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 484us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545753.130586:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 224 00000100:00100000:3.0:1789545753.135978:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545753.136147:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438185088 00000100:00100000:1.0:1789545753.136160:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438185088 00000100:00100000:1.0:1789545753.136232:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 63 00000100:00100000:1.0:1789545753.136244:0:8211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a8edb7a-f384-4468-93f4-9d664f284862+10:2359:x1876474438185088:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789545753.136268:0:8211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545753.136294:0:8211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6682aee/0x64919c0f856c151f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5791 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789545753.136328:0:8211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aaa4d19, blocks: 0x1 00010000:00010000:1.0:1789545753.136406:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=367s v=(0 0) 00010000:00010000:1.0:1789545753.136412:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789545753.136422:0:8211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6682aee/0x64919c0f856c151f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5791 expref: 11 pid: 8211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.136444:0:8211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6682aee/0x64919c0f856c151f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5791 expref: 11 pid: 8211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.136494:0:8211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba8800, rc 0) 00000100:00100000:1.0:1789545753.136569:0:8211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a8edb7a-f384-4468-93f4-9d664f284862+11:2359:x1876474438185088:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 326us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545753.136577:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 63 00000100:00100000:3.0:1789545753.142870:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545753.143162:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438185344 00000100:00100000:2.0:1789545753.143176:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438185344 00000100:00100000:2.0:1789545753.143316:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 225 00000100:00100000:2.0:1789545753.143331:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+66:11651:x1876474438185344:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789545753.143680:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+66:11651:x1876474438185344:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 Request processed in 351us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545753.143689:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 225 00000100:00100000:3.0:1789545753.149442:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545753.149854:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438185472 00000100:00100000:1.0:1789545753.149868:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438185472 00000100:00100000:1.0:1789545753.149957:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 64 00000100:00100000:1.0:1789545753.149971:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a8edb7a-f384-4468-93f4-9d664f284862+11:11651:x1876474438185472:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789545753.149996:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545753.150020:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d71a650/0x64919c0f856c1526 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5798 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.150060:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6682aee/0x64919c0f856c151f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5791 expref: 12 pid: 8211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.150071:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789545753.150076:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789545753.150083:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d71a650/0x64919c0f856c1526 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5798 expref: 12 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.150131:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a6682aee/0x64919c0f856c151f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5791 expref: 12 pid: 8211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.150146:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a6682aee/0x64919c0f856c151f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5791 expref: 12 pid: 8211 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545753.150183:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1876474454947456:192.168.201.16@tcp:104: 00000100:00100000:1.0:1789545753.150314:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdf465240 going to sleep for 11 seconds 00000100:00100000:3.0:1789545753.155794:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545753.156005:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438185600 00000100:00100000:2.0:1789545753.156019:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438185600 00010000:00010000:2.0:1789545753.156081:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a6682aee/0x64919c0f856c151f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5791 expref: 13 pid: 8211 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545753.156133:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 83 00000100:00100000:2.0:1789545753.156141:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+13:2358:x1876474438185600:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789545753.156161:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545753.156187:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a6682aee/0x64919c0f856c151f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5791 expref: 13 pid: 8211 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.156201:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a6682aee/0x64919c0f856c151f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5791 expref: 13 pid: 8211 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.156252:0:7637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545753.156256:0:7637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545753.156264:0:7637:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003d71a650/0x64919c0f856c1526 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5798 expref: 13 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.156273:0:7637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d71a650/0x64919c0f856c1526 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5798 expref: 13 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.156314:0:7637:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003d71a650/0x64919c0f856c1526 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5798 expref: 13 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545753.156328:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54a2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7637:1876474454947584:192.168.201.16@tcp:105: 00000100:00100000:2.0:1789545753.156453:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bedd78900 going to sleep for 11 seconds 00010000:00010000:1.0:1789545753.156782:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6682aee/0x64919c0f856c151f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5791 expref: 13 pid: 8211 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545753.156798:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1876474454947456:192.168.201.16@tcp:104: 00010000:00010000:1.0:1789545753.156829:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003d71a650/0x64919c0f856c1526 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5798 expref: 12 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.156842:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba8200, rc 0) 00000100:00100000:1.0:1789545753.156877:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a8edb7a-f384-4468-93f4-9d664f284862+12:11651:x1876474438185472:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 6910us (7452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545753.156895:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 64 00000100:00100000:3.0:1789545753.162142:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545753.162247:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438185728 00000100:00100000:0.0:1789545753.162259:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438185728 00000100:00100000:2.0:1789545753.162278:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54a2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7637:1876474454947584:192.168.201.16@tcp:105: 00010000:00010000:2.0:1789545753.162307:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:0.0:1789545753.162324:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff994bdfb41880 x1876474438185728/t0(0) o4->8a8edb7a-f384-4468-93f4-9d664f284862@192.168.201.16@tcp:219/0 lens 504/0 e 0 to 0 dl 1789545764 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789545753.162335:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994bdfb41880 with x1876474438185728 ext(0->12) 00002000:00010000:0.0:1789545753.162341:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff994bdfb41880 00000100:00100000:0.0:1789545753.162405:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 6 00000100:00100000:2.0:1789545753.162406:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+12:2358:x1876474438185600:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6266us (6628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545753.162416:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8a8edb7a-f384-4468-93f4-9d664f284862+12:2358:x1876474438185728:12345-192.168.201.16@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789545753.162417:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 83 00000100:00100000:0.0:1789545753.165012:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8a8edb7a-f384-4468-93f4-9d664f284862+13:2358:x1876474438185728:12345-192.168.201.16@tcp:4:lhsmtool_posix.0 Request processed in 1932us (2220us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789545753.165035:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 6 00002000:00100000:0.0:1789545753.165053:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff994bdfb41880 x1876474438185728/t4294967320(0) o4->8a8edb7a-f384-4468-93f4-9d664f284862@192.168.201.16@tcp:219/0 lens 504/448 e 0 to 0 dl 1789545764 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789545753.165079:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994bdfb41880 with x1876474438185728 ext(0->12) 00002000:00010000:0.0:1789545753.165087:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff994bdfb41880 00000100:00100000:3.0:1789545753.166964:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545753.167233:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438185856 00000100:00100000:1.0:1789545753.167246:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438185856 00000100:00100000:1.0:1789545753.167324:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 226 00000100:00100000:1.0:1789545753.167336:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+66:11651:x1876474438185856:12345-192.168.201.16@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789545753.210938:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967485 is committed 00000001:00080000:1.0:1789545753.210980:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1789545753.210990:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:1.0:1789545753.211016:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789545753.211035:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff994bc4a63a80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1789545753.211040:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994bee0ab000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff994bd1c48e40 00000020:00080000:1.0:1789545753.211065:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994bee0ab200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff994be4c1e000 00000004:00080000:1.0:1789545753.211086:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:1.0:1789545753.211120:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff994bf56a4540 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1789545753.211123:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994bc9c19200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff994bf56a4d80 00000020:00080000:1.0:1789545753.211126:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994bc9c19600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff994bdfb45400 00000020:00080000:1.0:1789545753.211349:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:0.0:1789545753.211816:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454947840:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789545753.211919:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545753.211974:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789545753.211981:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf6c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454947968:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789545753.212008:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545753.212049:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454947840 00000100:00100000:0.0:1789545753.212058:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454947840 00000100:00100000:0.0:1789545753.212121:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454947968 00000100:00100000:0.0:1789545753.212125:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454947968 00000100:00100000:0.0:1789545753.212152:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789545753.212162:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1876474454947840:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789545753.212389:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789545753.212394:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789545753 00002000:00010000:0.0:1789545753.212396:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789545753.212399:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789545753 -> 1789545753 00002000:00010000:0.0:1789545753.212401:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789545753.212451:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3313:x1876474454947840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 290us (532us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1789545753.212460:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789545753.212482:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789545753.212490:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1876474454947968:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789545753.212509:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00000100:00100000:2.0:1789545753.212647:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789545753.212660:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454947712:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789545753.212768:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545753.212806:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454947712 00000100:00100000:2.0:1789545753.212811:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454947712 00000100:00100000:2.0:1789545753.212833:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789545753.212840:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3311:x1876474454947712:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789545753.212869:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1789545753.212904:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c152d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.212935:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002fb0c3f3/0x64919c0f856c12ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56f7 expref: 12 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.212946:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789545753.212951:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789545753.212956:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c152d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.212999:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002fb0c3f3/0x64919c0f856c12ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56f7 expref: 12 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.213014:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002fb0c3f3/0x64919c0f856c12ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56f7 expref: 12 pid: 6692 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545753.213028:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1876474454948096:192.168.201.16@tcp:104: 00000100:00100000:2.0:1789545753.213106:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bedd78780 going to sleep for 11 seconds 00000100:00100000:3.0:1789545753.213446:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+20:11651:x1876474438185856:12345-192.168.201.16@tcp:44:lhsmtool_posix.0 Request processed in 46109us (46491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545753.213455:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 226 00000020:00080000:1.0:1789545753.216038:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1789545753.216119:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1876474454948096:192.168.201.16@tcp:104: 00010000:00010000:2.0:1789545753.216155:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c152d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789545753.218003:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aaa4d18, atime: 0x6aaa4d18, ctime: 0x6aaa4d18, blocks: 0x1 00010000:00010000:0.0:1789545753.218043:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ad00940/0x64919c0f856c1534 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.218065:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=367s v=(0 0) 00010000:00010000:0.0:1789545753.218070:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789545753.218079:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ad00940/0x64919c0f856c1534 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.218098:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ad00940/0x64919c0f856c1534 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.218109:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ad00940/0x64919c0f856c1534 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.218117:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ad00940/0x64919c0f856c1534 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.218145:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789545753.219115:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789545753.219129:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ad00940/0x64919c0f856c1534 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.219142:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6400 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545753.219148:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ad00940/0x64919c0f856c1534 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.219160:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ad00940/0x64919c0f856c1534 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.219192:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ad00940/0x64919c0f856c1534 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.219200:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ad00940/0x64919c0f856c1534 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.219226:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545753.219229:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545753.219231:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545753.220158:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545753.220338:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438185984 00000100:00100000:3.0:1789545753.220352:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438185984 00010000:00010000:3.0:1789545753.220494:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002fb0c3f3/0x64919c0f856c12ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56f7 expref: 13 pid: 6692 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789545753.220617:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789545753.220636:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789545753.220745:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545753.220770:0:8211:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1789545753.220781:0:8211:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1789545753.220932:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438186112 00000100:00100000:2.0:1789545753.220937:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438186112 00000100:00100000:2.0:1789545753.221041:0:12592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 68 00000100:00100000:2.0:1789545753.221055:0:12592:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8a8edb7a-f384-4468-93f4-9d664f284862+14:2358:x1876474438186112:12345-192.168.201.16@tcp:16:lhsmtool_posix.0 00000004:00080000:0.0:1789545753.223482:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff994be4ed7b80/2, rc 0, transno 4294967321 00000100:00100000:0.0:1789545753.223501:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454947840:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789545753.223653:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 84 00000100:00100000:3.0:1789545753.223674:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf4edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a8edb7a-f384-4468-93f4-9d664f284862+14:2358:x1876474438185984:12345-192.168.201.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789545753.224294:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1876474454947968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11803us (12282us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789545753.224306:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:3.0:1789545753.224449:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545753.224464:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002fb0c3f3/0x64919c0f856c12ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56f7 expref: 14 pid: 6692 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.224486:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002fb0c3f3/0x64919c0f856c12ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56f7 expref: 14 pid: 6692 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.224591:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb0c3f3/0x64919c0f856c12ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56f7 expref: 14 pid: 6692 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.224628:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789545753.224634:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789545753.224639:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c152d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.224650:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c152d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.224758:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545753.224821:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf4edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a8edb7a-f384-4468-93f4-9d664f284862+13:2358:x1876474438185984:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1157us (4671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545753.224832:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 84 00010000:00010000:0.0:1789545753.226790:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c152d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.226815:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c152d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.226849:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c152d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.226859:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c152d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.226906:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789545753.227972:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789545753.227986:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c152d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.228000:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0200 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:1.0:1789545753.228006:0:8453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c152d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.228018:0:8453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c152d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.228045:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c152d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.228053:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c152d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.228083:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545753.228095:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545753.228097:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789545753.228812:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff994be54c5180/2, rc 0, transno 4294967322 00000100:00100000:3.0:1789545753.228827:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454947712:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789545753.228966:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3311:x1876474454947712:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16124us (16196us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1789545753.228979:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:2.0:1789545753.231395:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff994bdf6c3480/2, rc 0, transno 4294967310 00000100:00100000:2.0:1789545753.231415:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf6c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454947968:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1789545753.264938:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:3.0:1789545753.264964:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:2.0:1789545753.265088:0:12592:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8a8edb7a-f384-4468-93f4-9d664f284862+7:2358:x1876474438186112:12345-192.168.201.16@tcp:16:lhsmtool_posix.0 Request processed in 44027us (44333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545753.265103:0:12592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 68 00000100:00100000:3.0:1789545753.267648:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545753.267714:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438186368 00000100:00100000:0.0:1789545753.267725:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438186368 00000100:00100000:0.0:1789545753.267790:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 227 00000100:00100000:0.0:1789545753.267801:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+20:11651:x1876474438186368:12345-192.168.201.16@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789545753.267876:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789545753.267923:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1518 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de578a expref: 20 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.267944:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff994bcd248000) 00010000:00010000:0.0:1789545753.267951:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789545753.267994:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c153b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.268009:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c153b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.268035:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c153b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789545753.268299:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f412260e reply state 000000002065885a transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c153b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545753.268307:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789545753.268854:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+21:11651:x1876474438186368:12345-192.168.201.16@tcp:36:lhsmtool_posix.0 Request processed in 1051us (1214us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1789545753.268864:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 227 00000100:00100000:3.0:1789545753.270687:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545753.270760:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438186496 00000100:00100000:2.0:1789545753.270773:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438186496 00000100:00100000:2.0:1789545753.270919:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 69 00000100:00100000:2.0:1789545753.270931:0:8211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a8edb7a-f384-4468-93f4-9d664f284862+7:2359:x1876474438186496:12345-192.168.201.16@tcp:2:lhsmtool_posix.0 00010000:00010000:0.0:1789545753.271156:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c153b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.271170:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c153b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.271179:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c153b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.271187:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb7000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545753.271192:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c153b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.271201:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c153b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.271221:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff994bcd248000) 00010000:00010000:0.0:1789545753.271224:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545753.271230:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c153b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.271254:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c153b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789545753.271302:0:8211:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789545753.271305:0:8211:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1789545753 -> 1789545752 00002000:00010000:2.0:1789545753.271307:0:8211:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789545752 00002000:00010000:2.0:1789545753.271309:0:8211:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789545753 -> 1789545752 00002000:00010000:2.0:1789545753.271310:0:8211:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789545753.271414:0:8211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a8edb7a-f384-4468-93f4-9d664f284862+8:2359:x1876474438186496:12345-192.168.201.16@tcp:2:lhsmtool_posix.0 Request processed in 484us (734us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1789545753.271423:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 69 00000100:00100000:2.0:1789545753.273229:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545753.273323:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438186752 00000100:00100000:1.0:1789545753.273336:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438186752 00000100:00100000:1.0:1789545753.273620:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 228 00000100:00100000:1.0:1789545753.273633:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+20:11651:x1876474438186752:12345-192.168.201.16@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789545753.273766:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1542 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.273785:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c14fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de577c expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.273791:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1542 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.273835:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c14fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de577c expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.273851:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c14fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de577c expref: 20 pid: 5846 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545753.273869:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf4edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876474454948224:192.168.201.16@tcp:104: 00000100:00100000:1.0:1789545753.273991:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc2e470c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789545753.277077:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf4edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876474454948224:192.168.201.16@tcp:104: 00010000:00010000:2.0:1789545753.277118:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1542 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545753.279266:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545753.279762:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438186880 00000100:00100000:1.0:1789545753.279778:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438186880 00010000:00010000:1.0:1789545753.279839:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c14fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de577c expref: 21 pid: 5846 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545753.279944:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 85 00000100:00100000:1.0:1789545753.279980:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a8edb7a-f384-4468-93f4-9d664f284862+21:2358:x1876474438186880:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789545753.280004:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545753.280013:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c14fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de577c expref: 21 pid: 5846 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.280029:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c14fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de577c expref: 21 pid: 5846 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.280057:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c14fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de577c expref: 21 pid: 5846 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.280078:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff994bcd248000) 00010000:00010000:1.0:1789545753.280084:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1542 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.280095:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1542 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.280105:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1542 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.280148:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789545753.280279:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a8edb7a-f384-4468-93f4-9d664f284862+20:2358:x1876474438186880:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 302us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545753.280288:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 85 00010000:00010000:2.0:1789545753.280352:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1542 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.280379:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1542 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.280420:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1542 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.280428:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1542 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.280435:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1542 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.280441:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba9800 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545753.280447:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1542 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.280455:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1542 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.280476:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff994bcd248000) 00010000:00010000:2.0:1789545753.280480:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789545753.280484:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1542 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.280513:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9800/0x64919c0f856c1542 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545753.280569:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+19:11651:x1876474438186752:12345-192.168.201.16@tcp:55:lhsmtool_posix.0 Request processed in 6939us (7350us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789545753.280577:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 228 00000100:00100000:1.0:1789545753.283861:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545753.284068:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438187008 00000100:00100000:0.0:1789545753.284083:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438187008 00000100:00100000:0.0:1789545753.284166:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 70 00000100:00100000:0.0:1789545753.284178:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+8:2359:x1876474438187008:12345-192.168.201.16@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789545753.284239:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005f5022d3/0x64919c0f856c1549 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.284266:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003d71a650/0x64919c0f856c1526 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5798 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.284275:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789545753.284280:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789545753.284285:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f5022d3/0x64919c0f856c1549 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.284334:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003d71a650/0x64919c0f856c1526 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5798 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.284351:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003d71a650/0x64919c0f856c1526 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5798 expref: 8 pid: 6692 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545753.284510:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1876474454948352:192.168.201.16@tcp:104: 00000100:00100000:0.0:1789545753.284901:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd938cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789545753.289354:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545753.289841:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438187136 00000100:00100000:1.0:1789545753.289855:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438187136 00010000:00010000:1.0:1789545753.289923:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003d71a650/0x64919c0f856c1526 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5798 expref: 9 pid: 6692 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545753.289993:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 86 00000100:00100000:1.0:1789545753.290006:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+9:2359:x1876474438187136:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789545753.290027:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545753.290058:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003d71a650/0x64919c0f856c1526 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5798 expref: 9 pid: 6692 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.290075:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003d71a650/0x64919c0f856c1526 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5798 expref: 9 pid: 6692 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.290110:0:7637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789545753.290116:0:7637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789545753.290123:0:7637:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005f5022d3/0x64919c0f856c1549 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.290137:0:7637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f5022d3/0x64919c0f856c1549 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.290163:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789545753.290234:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a8edb7a-f384-4468-93f4-9d664f284862+9:2359:x1876474438187136:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 231us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545753.290241:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 86 00010000:00010000:2.0:1789545753.290446:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d71a650/0x64919c0f856c1526 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5798 expref: 8 pid: 6692 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545753.290465:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1876474454948352:192.168.201.16@tcp:104: 00010000:00010000:2.0:1789545753.290503:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005f5022d3/0x64919c0f856c1549 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.290611:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005f5022d3/0x64919c0f856c1549 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.290621:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f5022d3/0x64919c0f856c1549 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.290652:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005f5022d3/0x64919c0f856c1549 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.290662:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f5022d3/0x64919c0f856c1549 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.290692:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f5022d3/0x64919c0f856c1549 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.290700:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6600 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:2.0:1789545753.290705:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f5022d3/0x64919c0f856c1549 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.290714:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f5022d3/0x64919c0f856c1549 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.290726:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f5022d3/0x64919c0f856c1549 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.290732:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f5022d3/0x64919c0f856c1549 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545753.290792:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+7:2359:x1876474438187008:12345-192.168.201.16@tcp:1:lhsmtool_posix.0 Request processed in 6617us (6945us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545753.290800:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 70 00000100:00100000:2.0:1789545753.294657:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545753.294764:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438187392 00000100:00100000:3.0:1789545753.294780:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438187392 00000100:00100000:3.0:1789545753.294871:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 229 00000100:00100000:3.0:1789545753.294892:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+19:11651:x1876474438187392:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789545753.295086:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ba00/0x64919c0f856c1550 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.295135:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ba00/0x64919c0f856c1550 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.295150:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ba00/0x64919c0f856c1550 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.295761:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1557 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.295777:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c150a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5783 expref: 20 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.295787:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1557 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.295837:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c150a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5783 expref: 20 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.295854:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c150a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5783 expref: 20 pid: 10125 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545753.295871:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876474454948480:192.168.201.16@tcp:104: 00000100:00100000:0.0:1789545753.296006:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd938cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789545753.298774:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545753.298915:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438187520 00000100:00100000:2.0:1789545753.298929:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438187520 00010000:00010000:2.0:1789545753.299095:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c150a lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5783 expref: 21 pid: 10125 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545753.299147:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876474454948480:192.168.201.16@tcp:104: 00000100:00100000:2.0:1789545753.299170:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 87 00010000:00010000:1.0:1789545753.299178:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1557 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545753.299179:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+21:2359:x1876474438187520:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789545753.299199:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545753.299206:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c150a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5783 expref: 21 pid: 10125 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.299218:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c150a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5783 expref: 21 pid: 10125 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.299244:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c150a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5783 expref: 21 pid: 10125 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.299263:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff994bcd248000) 00010000:00010000:2.0:1789545753.299268:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1557 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.299279:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1557 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.299287:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1557 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.299311:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789545753.299338:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1557 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.299346:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1557 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545753.299492:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a8edb7a-f384-4468-93f4-9d664f284862+20:2359:x1876474438187520:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 312us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545753.299501:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 87 00000001:00080000:1.0:1789545753.300802:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1789545753.301039:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1789545753.301090:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1789545753.301209:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be76c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1876474454948608:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789545753.301315:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545753.301747:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc2e47cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789545753.301860:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454948608 00000100:00100000:2.0:1789545753.301878:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454948608 00000100:00100000:2.0:1789545753.302011:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789545753.302023:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1876474454948608:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789545753.302156:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1876474454948608:12345-0@lo:1000:mdt00_000.0 Request processed in 135us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545753.302164:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789545753.302235:0:5846:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:1.0:1789545753.302242:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff994be4941f80, transno 4294967315 00000004:00080000:1.0:1789545753.302267:0:5846:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:1.0:1789545753.302288:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff994be4ed7b80, transno 4294967321 00000100:00100000:1.0:1789545753.302297:0:5846:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff994be54c5180 x1876474454947712/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789545769 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545753.302311:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be76c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1876474454948608:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1789545753.306225:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1789545753.306397:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be76c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1876474454948736:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789545753.306495:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545753.313018:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc2e473c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789545753.313101:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454948736 00000100:00100000:3.0:1789545753.313116:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454948736 00000100:00100000:3.0:1789545753.313192:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789545753.313203:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1876474454948736:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789545753.313954:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5846:x1876474454948736:12345-0@lo:1000:mdt00_000.0 Request processed in 747us (7454us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1789545753.313965:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789545753.315925:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be76c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1876474454948736:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1789545753.316117:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1557 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.316132:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1557 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.316141:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1557 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.316149:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb7200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545753.316155:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1557 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.316191:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1557 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.316213:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff994bcd248000) 00010000:00010000:0.0:1789545753.316216:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789545753.316223:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1557 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.316230:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1557 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.316277:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11aa00/0x64919c0f856c149a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.316284:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11aa00/0x64919c0f856c149a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.316289:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11aa00/0x64919c0f856c149a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.316295:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bee11aa00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545753.316298:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11aa00/0x64919c0f856c149a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.316304:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11aa00/0x64919c0f856c149a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.316312:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f11b00) 00010000:00010000:0.0:1789545753.316315:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789545753.316324:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c14a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5767 expref: 23 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.316351:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c14a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5767 expref: 23 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.319061:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c14a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5767 expref: 23 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.319174:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c14a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5767 expref: 23 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545753.319195:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876474454948864:192.168.201.16@tcp:105: 00000100:00100000:0.0:1789545753.319416:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd938cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789545753.323186:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545753.323264:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438187648 00000100:00100000:3.0:1789545753.323278:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438187648 00000100:00100000:3.0:1789545753.323352:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 61 00000100:00100000:3.0:1789545753.323390:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+24:11650:x1876474438187648:12345-192.168.201.16@tcp:49:lfs.0 00000100:00100000:3.0:1789545753.323904:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+24:11650:x1876474438187648:12345-192.168.201.16@tcp:49:lfs.0 Request processed in 515us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545753.323918:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 61 00000100:00100000:2.0:1789545753.324120:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876474454948864:192.168.201.16@tcp:105: 00010000:00010000:2.0:1789545753.324157:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11aa00/0x64919c0f856c149a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.324170:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11aa00/0x64919c0f856c149a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.324218:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c155e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.324240:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c155e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.324255:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c155e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.324268:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c155e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.324275:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c155e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.324282:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c155e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.324288:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1e00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545753.325131:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c155e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.325147:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c155e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.325167:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f11b00) 00010000:00010000:2.0:1789545753.325171:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545753.325176:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c155e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.325184:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c155e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.325202:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ba00/0x64919c0f856c1550 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.325210:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ba00/0x64919c0f856c1550 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.325215:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ba00/0x64919c0f856c1550 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.325221:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bee11ba00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545753.325224:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ba00/0x64919c0f856c1550 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.325229:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ba00/0x64919c0f856c1550 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.325236:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f11b00) 00010000:00010000:2.0:1789545753.325239:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789545753.325255:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ba00/0x64919c0f856c1550 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.325262:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ba00/0x64919c0f856c1550 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545753.326822:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545753.326942:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438187904 00000100:00100000:3.0:1789545753.326956:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438187904 00000100:00100000:3.0:1789545753.327082:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 230 00000100:00100000:3.0:1789545753.327095:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+24:11650:x1876474438187904:12345-192.168.201.16@tcp:58:lfs.0 00000100:00100000:2.0:1789545753.327258:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+24:11651:x1876474438187392:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 Request processed in 32375us (32617us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1789545753.327267:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 229 00000020:00080000:2.0:1789545753.327273:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789545753.327746:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789545753.327752:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789545753.328061:0:10125:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1789545753.328135:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+23:11650:x1876474438187904:12345-192.168.201.16@tcp:58:lfs.0 Request processed in 1041us (1323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545753.328156:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 230 00000040:00080000:0.0:1789545753.328258:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789545753.328270:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789545753.328433:0:11700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ed7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1876474454948992:192.168.201.16@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789545753.328508:0:11700:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd938cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789545753.337179:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545753.337232:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438188160 00000100:00100000:1.0:1789545753.337246:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438188160 00000100:00100000:1.0:1789545753.337316:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 62 00000100:00100000:1.0:1789545753.337348:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+24:11651:x1876474438188160:12345-192.168.201.16@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789545753.337746:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000004:00080000:1.0:1789545753.338468:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:0.0:1789545753.338878:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438188288 00000100:00100000:0.0:1789545753.338899:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438188288 00000100:00100000:0.0:1789545753.338967:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 231 00000100:00100000:0.0:1789545753.338979:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+26:11652:x1876474438188288:12345-192.168.201.16@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789545753.339020:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789545753.339165:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+26:11652:x1876474438188288:12345-192.168.201.16@tcp:53:lhsmtool_posix.0 Request processed in 187us (1828us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545753.339183:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 231 00000100:00100000:3.0:1789545753.340990:0:11700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ed7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1876474454948992:192.168.201.16@tcp:107:hsm_cdtr.0 00000001:00080000:1.0:1789545753.344343:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1789545753.345854:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1565 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.345892:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1565 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.345909:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1565 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.345921:0:5850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1565 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.345929:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1565 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.345936:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1565 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.345969:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789545753.346140:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+25:11651:x1876474438188160:12345-192.168.201.16@tcp:35:lhsmtool_posix.0 Request processed in 8788us (8968us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1789545753.346153:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 62 00000020:00080000:1.0:1789545753.346162:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789545753.351828:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789545753.351850:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1565 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.351866:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba9200 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545753.351872:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1565 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.351891:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1565 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.351916:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff994bc4ffe100) 00010000:00010000:3.0:1789545753.351919:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789545753.351926:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1565 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.351932:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9200/0x64919c0f856c1565 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.351963:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545753.351966:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545753.351967:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545753.353696:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545753.353832:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438188544 00000100:00100000:0.0:1789545753.353851:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438188544 00000100:00100000:0.0:1789545753.353943:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 232 00000100:00100000:0.0:1789545753.353968:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+25:11652:x1876474438188544:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789545753.353989:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545753.354011:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c156c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de579f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.354108:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1573 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.354122:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.354133:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789545753.354143:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789545753.354285:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c156c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de579f expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.354307:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1573 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de579f expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.354316:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f11b00) 00010000:00010000:0.0:1789545753.354318:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789545753.354322:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb7000, rc 0) 00000100:00100000:0.0:1789545753.354431:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+27:11652:x1876474438188544:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 471us (748us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1789545753.354439:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 232 00000100:00100000:0.0:1789545753.369633:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545753.369723:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438188800 00000100:00100000:2.0:1789545753.369734:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438188800 00000100:00100000:2.0:1789545753.369796:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 233 00000100:00100000:2.0:1789545753.369806:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+27:11652:x1876474438188800:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789545753.369894:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c1581 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.369914:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c1581 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.369926:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c1581 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.370117:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c1581 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.370125:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c1581 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.370150:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c1581 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.370157:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0a00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545753.370162:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c1581 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.370171:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c1581 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.370184:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f11b00) 00010000:00010000:2.0:1789545753.370188:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789545753.370193:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c1581 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545753.370200:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0a00/0x64919c0f856c1581 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545753.370397:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a8edb7a-f384-4468-93f4-9d664f284862+28:11652:x1876474438188800:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 Request processed in 591us (772us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1789545753.370407:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 233 00000040:00080000:3.0:1789545753.370688:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789545753.370693:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789545753.371204:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789545753.371212:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789545753.387744:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545753.387834:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545753.388495:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438189056 00000100:00100000:3.0:1789545753.388520:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438189056 00000100:00100000:0.0:1789545753.388655:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438189184 00000100:00100000:0.0:1789545753.388659:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438189184 00000100:00100000:0.0:1789545753.388709:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 234 00000100:00100000:0.0:1789545753.388719:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+29:11654:x1876474438189184:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:0.0:1789545753.388741:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545753.388760:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c1588 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de57a6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.388829:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c158f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.388844:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c158f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.388855:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c158f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.388868:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c1596 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.388875:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c1596 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.388891:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c1596 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545753.389080:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 63 00000100:00100000:3.0:1789545753.389090:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+30:11652:x1876474438189056:12345-192.168.201.16@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789545753.389302:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+31:11652:x1876474438189056:12345-192.168.201.16@tcp:35:lhsmtool_posix.0 Request processed in 213us (1567us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1789545753.389310:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 63 00010000:00010000:0.0:1789545753.389655:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c159d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.389673:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ac00/0x64919c0f856c148c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5760 expref: 30 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.389682:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c159d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.389718:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ac00/0x64919c0f856c148c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5760 expref: 30 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545753.389732:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ac00/0x64919c0f856c148c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5760 expref: 30 pid: 5848 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545753.389746:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c1d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876474454949120:192.168.201.16@tcp:104: 00000100:00100000:0.0:1789545753.389831:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd938c900 going to sleep for 11 seconds 00000100:00100000:3.0:1789545753.397694:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c1d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876474454949120:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545753.397723:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c159d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545753.398254:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545753.398393:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438189440 00000100:00100000:1.0:1789545753.398401:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438189440 00000100:00100000:1.0:1789545753.398453:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 64 00000100:00100000:1.0:1789545753.398462:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+31:5593:x1876474438189440:12345-192.168.201.16@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789545753.398719:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+32:5593:x1876474438189440:12345-192.168.201.16@tcp:35:ldlm_bl.0 Request processed in 257us (467us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1789545753.398728:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 64 00000100:00100000:2.0:1789545753.400721:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545753.400809:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438189568 00000100:00100000:1.0:1789545753.400818:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438189568 00010000:00010000:1.0:1789545753.400861:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ac00/0x64919c0f856c148c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5760 expref: 32 pid: 5848 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545753.400944:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 88 00000100:00100000:1.0:1789545753.400954:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd9364450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a8edb7a-f384-4468-93f4-9d664f284862+32:2359:x1876474438189568:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789545753.400978:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545753.400985:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ac00/0x64919c0f856c148c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5760 expref: 32 pid: 5848 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.400999:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ac00/0x64919c0f856c148c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5760 expref: 32 pid: 5848 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.401020:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11ac00/0x64919c0f856c148c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5760 expref: 32 pid: 5848 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.401037:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f11b00) 00010000:00010000:1.0:1789545753.401041:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c159d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.401051:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c159d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.401059:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c159d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545753.401104:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789545753.401158:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd9364450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a8edb7a-f384-4468-93f4-9d664f284862+31:2359:x1876474438189568:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 204us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545753.401166:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 88 00010000:00010000:3.0:1789545753.401245:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c159d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.401253:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c159d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545753.401306:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789545753.401310:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789545753.401330:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c159d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.401344:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c159d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.401353:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c158f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.401387:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c158f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.401393:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c158f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.401408:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545753.401412:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c158f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.401420:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c158f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.401430:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:3.0:1789545753.401433:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545753.401437:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c158f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.401442:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c158f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.401453:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c1596 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.401459:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c1596 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.401477:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c1596 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.401482:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545753.401485:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c1596 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.401492:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c1596 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.401510:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994bc4f11000) 00010000:00010000:3.0:1789545753.401513:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545753.401516:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c1596 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.401522:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c1596 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.401556:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c1588 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de57a6 expref: 31 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.401570:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c159d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de57a6 expref: 30 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545753.401575:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f11b00) 00010000:00010000:3.0:1789545753.401577:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789545753.401580:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb6600, rc 0) 00000100:00100000:3.0:1789545753.401607:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a8edb7a-f384-4468-93f4-9d664f284862+30:11654:x1876474438189184:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 12890us (13773us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545753.401614:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 234 00010000:00010000:3.0:1789545753.411106:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789545754.151695:0:12630:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789545754.151703:0:12630:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789545754.151765:0:12630:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789545754.151771:0:12630:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789545754.178794:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf4edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454949248:0@lo:400:kworker.0 00000100:00100000:1.0:1789545754.178878:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545754.178920:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454949760:0@lo:400:kworker.0 00000100:00100000:1.0:1789545754.178943:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545754.178968:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789545754.178972:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454949376:0@lo:400:kworker.0 00000100:00100000:1.0:1789545754.178988:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545754.179003:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454949888:0@lo:400:kworker.0 00000100:00100000:1.0:1789545754.179022:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545754.179049:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454949504:0@lo:400:kworker.0 00000100:00100000:1.0:1789545754.179070:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545754.179085:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789545754.179091:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454949632:0@lo:400:kworker.0 00000100:00100000:1.0:1789545754.179110:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545754.179138:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454949248 00000100:00100000:1.0:1789545754.179145:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454949248 00000100:00100000:1.0:1789545754.179190:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789545754.179199:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454949248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545754.179246:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454949248:12345-0@lo:400:kworker.0 Request processed in 48us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545754.179263:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789545754.179293:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454949760 00000100:00100000:1.0:1789545754.179297:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454949760 00000100:00100000:1.0:1789545754.179330:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454949376 00000100:00100000:1.0:1789545754.179333:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454949376 00000100:00100000:1.0:1789545754.179345:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454949504 00000100:00100000:1.0:1789545754.179346:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454949504 00000100:00100000:1.0:1789545754.179381:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789545754.179387:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454949760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545754.179419:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454949760:12345-0@lo:400:kworker.0 Request processed in 33us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545754.179425:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789545754.179437:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789545754.179442:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454949376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545754.179467:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454949376:12345-0@lo:400:kworker.0 Request processed in 25us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545754.179472:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789545754.179483:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789545754.179489:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc641ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454949504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545754.179517:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc641ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454949504:12345-0@lo:400:kworker.0 Request processed in 29us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545754.179522:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789545754.179540:0:12592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454949888 00000100:00100000:1.0:1789545754.179543:0:12592:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454949888 00000100:00100000:1.0:1789545754.179567:0:12592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454949632 00000100:00100000:1.0:1789545754.179569:0:12592:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454949632 00000100:00100000:1.0:1789545754.180220:0:12592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789545754.180233:0:12592:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3311:x1876474454949888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545754.180275:0:12592:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3311:x1876474454949888:12345-0@lo:400:kworker.0 Request processed in 43us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545754.180281:0:12592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789545754.180292:0:12592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789545754.180298:0:12592:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4941f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3313:x1876474454949632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545754.180324:0:12592:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4941f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3313:x1876474454949632:12345-0@lo:400:kworker.0 Request processed in 27us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545754.180330:0:12592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1789545754.180354:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789545754.180419:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454949632:0@lo:400:kworker.0 00000100:00100000:1.0:1789545754.180430:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454949504:0@lo:400:kworker.0 00000100:00100000:1.0:1789545754.180464:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454949376:0@lo:400:kworker.0 00000100:00100000:1.0:1789545754.180474:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454949888:0@lo:400:kworker.0 00000100:00100000:1.0:1789545754.180483:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf4edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454949248:0@lo:400:kworker.0 00000100:00100000:1.0:1789545754.180491:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454949760:0@lo:400:kworker.0 00000001:00080000:2.0:1789545754.239857:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1789545754.239889:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:2.0:1789545754.326048:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545754.326082:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438189824 00000100:00100000:2.0:1789545754.326096:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438189824 00000100:00100000:2.0:1789545754.326147:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 235 00000100:00100000:2.0:1789545754.326157:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+30:11677:x1876474438189824:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:2.0:1789545754.326181:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545754.326200:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c15a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de57ad expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545754.326299:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c15ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545754.326315:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c15ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545754.326329:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c15ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545754.326340:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789545754.326476:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c15a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de57ad expref: 33 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545754.326494:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c15ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de57ad expref: 32 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545754.326503:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f11b00) 00010000:00010000:2.0:1789545754.326506:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789545754.326509:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0c00, rc 0) 00000100:00100000:2.0:1789545754.326563:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+32:11677:x1876474438189824:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 406us (523us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1789545754.327675:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 235 00000100:00100000:1.0:1789545754.333544:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545754.335459:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438189952 00000100:00100000:2.0:1789545754.335473:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438189952 00000100:00100000:2.0:1789545754.335579:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 236 00000100:00100000:2.0:1789545754.335590:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+32:11677:x1876474438189952:12345-192.168.201.16@tcp:54:lfs.0 00010000:00010000:2.0:1789545754.335662:0:10125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c15b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545754.335680:0:10125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c15b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545754.335692:0:10125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c15b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545754.335721:0:10125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c15b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545754.335729:0:10125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c15b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545754.335736:0:10125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c15b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545754.335743:0:10125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545754.335748:0:10125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c15b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545754.335756:0:10125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c15b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545754.335768:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f11b00) 00010000:00010000:2.0:1789545754.335771:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789545754.335783:0:10125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c15b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545754.335789:0:10125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c15b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545754.335892:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a8edb7a-f384-4468-93f4-9d664f284862+32:11677:x1876474438189952:12345-192.168.201.16@tcp:54:lfs.0 Request processed in 302us (2355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545754.335899:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 236 00010000:00010000:1.0:1789545754.431032:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545754.437999:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545754.438213:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438190080 00000100:00100000:0.0:1789545754.438226:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438190080 00000100:00100000:0.0:1789545754.438295:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 71 00000100:00100000:0.0:1789545754.438305:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+7:2358:x1876474438190080:12345-192.168.201.16@tcp:101:cat.0 00010000:00010000:0.0:1789545754.438323:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545754.438345:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000712e86a3/0x64919c0f856c15c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de57b4 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789545754.438402:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aaa4d18, atime: 0x6aaa4d18, ctime: 0x6aaa4d18, blocks: 0xb 00010000:00010000:1.0:1789545754.438475:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=368s v=(0 0) 00010000:00010000:1.0:1789545754.438481:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789545754.438492:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000712e86a3/0x64919c0f856c15c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de57b4 expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545754.438511:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000712e86a3/0x64919c0f856c15c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de57b4 expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545754.438533:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb6800, rc 0) 00000100:00100000:1.0:1789545754.438597:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+8:2358:x1876474438190080:12345-192.168.201.16@tcp:101:cat.0 Request processed in 293us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545754.438605:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 71 00000100:00100000:0.0:1789545754.445556:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545754.445919:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438190208 00000100:00100000:1.0:1789545754.445931:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438190208 00002000:00100000:1.0:1789545754.446002:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff994bc9c1f800 x1876474438190208/t0(0) o3->8a8edb7a-f384-4468-93f4-9d664f284862@192.168.201.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1789545765 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789545754.446015:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994bc9c1f800 with x1876474438190208 ext(0->4095) 00002000:00010000:1.0:1789545754.446023:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff994bc9c1f800 00000100:00100000:1.0:1789545754.446059:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7 00000100:00100000:1.0:1789545754.446069:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8a8edb7a-f384-4468-93f4-9d664f284862+8:2359:x1876474438190208:12345-192.168.201.16@tcp:3:cat.0 00000100:00100000:1.0:1789545754.446290:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8a8edb7a-f384-4468-93f4-9d664f284862+8:2359:x1876474438190208:12345-192.168.201.16@tcp:3:cat.0 Request processed in 221us (743us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789545754.446298:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7 00002000:00100000:1.0:1789545754.446306:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff994bc9c1f800 x1876474438190208/t0(0) o3->8a8edb7a-f384-4468-93f4-9d664f284862@192.168.201.16@tcp:220/0 lens 488/4536 e 0 to 0 dl 1789545765 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789545754.446314:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994bc9c1f800 with x1876474438190208 ext(0->4095) 00002000:00010000:1.0:1789545754.446317:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff994bc9c1f800 00000100:00100000:0.0:1789545754.684841:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454950144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789545754.684923:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454950016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789545754.684965:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545754.685009:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545754.685118:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454950144 00000100:00100000:1.0:1789545754.685128:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454950144 00000100:00100000:3.0:1789545754.685182:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454950016 00000100:00100000:1.0:1789545754.685189:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789545754.685194:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454950016 00000100:00100000:1.0:1789545754.685203:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454950144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789545754.685258:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789545754.685315:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454950144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545754.685323:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789545754.685342:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789545754.685349:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1876474454950016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789545754.685386:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1789545754.685421:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1876474454950016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545754.685428:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789545754.685428:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1789545754.685440:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1789545754.685476:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff994bdf6c3480, transno 4294967310 00000100:00100000:0.0:1789545754.685509:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454950144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789545754.687691:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454950016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789545755.076754:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545755.076813:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545755.076856:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545755.076892:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545755.076918:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545755.076967:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438190336 00000100:00100000:1.0:1789545755.076980:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438190336 00000100:00100000:1.0:1789545755.077046:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 298 00000100:00100000:1.0:1789545755.077058:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2359:x1876474438190336:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545755.077150:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2359:x1876474438190336:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 93us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545755.077158:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 298 00000100:00100000:1.0:1789545755.077202:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438190720 00000100:00100000:1.0:1789545755.077207:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438190720 00000100:00100000:1.0:1789545755.077249:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438190592 00000100:00100000:1.0:1789545755.077252:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438190592 00000100:00100000:1.0:1789545755.077298:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 92 00000100:00100000:1.0:1789545755.077305:0:8211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4942d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a8edb7a-f384-4468-93f4-9d664f284862+5:2359:x1876474438190720:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545755.077337:0:8211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4942d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a8edb7a-f384-4468-93f4-9d664f284862+5:2359:x1876474438190720:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 32us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545755.077342:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 92 00000100:00100000:1.0:1789545755.077355:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 93 00000100:00100000:1.0:1789545755.077401:0:8211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4943480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a8edb7a-f384-4468-93f4-9d664f284862+8:2359:x1876474438190592:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545755.077429:0:8211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4943480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a8edb7a-f384-4468-93f4-9d664f284862+8:2359:x1876474438190592:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 31us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545755.077450:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 93 00000100:00080000:1.0:1789545755.077468:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789545755.077473:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789545755.077740:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438190464 00000100:00100000:2.0:1789545755.077748:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438190464 00000100:00100000:2.0:1789545755.077801:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438190848 00000100:00100000:2.0:1789545755.077805:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438190848 00000100:00100000:2.0:1789545755.077830:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 157 00000100:00100000:2.0:1789545755.077837:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+32:2359:x1876474438190464:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545755.077882:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+32:2359:x1876474438190464:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 46us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545755.077888:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 157 00000100:00100000:2.0:1789545755.077901:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 158 00000100:00100000:2.0:1789545755.077907:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf6c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2359:x1876474438190848:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545755.077928:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf6c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2359:x1876474438190848:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 21us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545755.077933:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 158 00000100:00080000:1.0:1789545755.078348:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789545755.455279:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789545756.476735:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789545756.476750:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789545756.476794:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789545756.476803:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789545756.480119:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545757.502261:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789545758.351379:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967515 is committed 00000001:00080000:3.0:1789545758.351501:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:3.0:1789545758.351517:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff994bc2e47cc0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1789545758.351522:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994bee0ab500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff994bc2e47d80 00000020:00080000:3.0:1789545758.351534:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994bee0ab700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff994bcd059c00 00000020:00080000:3.0:1789545758.351559:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1789545758.351583:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1789545758.351812:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:3.0:1789545758.352153:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000001:00080000:3.0:1789545758.370494:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:3.0:1789545758.370515:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:3.0:1789545758.370526:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:3.0:1789545758.525001:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545758.983008:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545758.983203:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438190976 00000100:00100000:3.0:1789545758.983213:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438190976 00000100:00100000:3.0:1789545758.983300:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 237 00000100:00080000:0.0:1789545758.983308:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789545758.983315:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+19:11330:x1876474438190976:12345-192.168.201.16@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789545758.983440:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+19:11330:x1876474438190976:12345-192.168.201.16@tcp:60:lhsmtool_posix.0 Request processed in 130us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545758.983448:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 237 00000100:00100000:0.0:1789545758.990581:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545758.990656:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438191232 00000100:00100000:3.0:1789545758.990666:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438191232 00000100:00100000:3.0:1789545758.990724:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 65 00000100:00100000:3.0:1789545758.990734:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+19:11330:x1876474438191232:12345-192.168.201.16@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789545758.991095:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+20:11330:x1876474438191232:12345-192.168.201.16@tcp:35:lhsmtool_posix.0 Request processed in 362us (524us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1789545758.991104:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 65 00000100:00100000:2.0:1789545759.293219:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454950528:0@lo:400:kworker.0 00000100:00100000:2.0:1789545759.293288:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545759.293378:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789545759.293386:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454950656:0@lo:400:kworker.0 00000100:00100000:2.0:1789545759.293412:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545759.293449:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454950528 00000100:00100000:2.0:1789545759.293457:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454950528 00000100:00100000:2.0:1789545759.293511:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789545759.293521:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454950528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545759.294009:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454950528:0@lo:400:kworker.0 00000100:00100000:2.0:1789545759.294085:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454950528:12345-0@lo:400:kworker.0 Request processed in 57us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545759.294093:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789545759.294214:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be3a9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454950272:0@lo:400:kworker.0 00000100:00100000:1.0:1789545759.294261:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545759.294296:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454950784:0@lo:400:kworker.0 00000100:00100000:1.0:1789545759.294319:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545759.294346:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789545759.294353:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bd8d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454950400:0@lo:400:kworker.0 00000100:00100000:1.0:1789545759.294402:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545759.294421:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454950912:0@lo:400:kworker.0 00000100:00100000:1.0:1789545759.294442:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545759.294475:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454950656 00000100:00100000:1.0:1789545759.294495:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454950656 00000100:00100000:1.0:1789545759.294529:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454950912 00000100:00100000:1.0:1789545759.294532:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454950912 00000100:00100000:1.0:1789545759.294554:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789545759.294561:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454950656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545759.294660:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454950656:12345-0@lo:400:kworker.0 Request processed in 98us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545759.294666:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789545759.294680:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789545759.294686:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454950912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545759.294717:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454950912:12345-0@lo:400:kworker.0 Request processed in 32us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545759.294723:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789545759.294739:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454950784 00000100:00100000:1.0:1789545759.294744:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454950784 00000100:00100000:2.0:1789545759.294902:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454950272 00000100:00100000:2.0:1789545759.294907:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454950272 00000100:00100000:2.0:1789545759.294934:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1789545759.294941:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454950272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545759.294975:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3311:x1876474454950272:12345-0@lo:400:kworker.0 Request processed in 34us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545759.294981:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1789545759.295025:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1789545759.295031:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff994be54c5180, transno 4294967322 00000004:00080000:2.0:1789545759.295040:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1789545759.295057:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454950656:0@lo:400:kworker.0 00000100:00100000:2.0:1789545759.295111:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454950912:0@lo:400:kworker.0 00000100:00100000:2.0:1789545759.295119:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be3a9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454950272:0@lo:400:kworker.0 00000100:00100000:1.0:1789545759.295183:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454950400 00000100:00100000:1.0:1789545759.295187:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454950400 00000100:00080000:0.0:1789545759.295271:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789545759.295276:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789545759.295278:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789545759.298998:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789545759.299025:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf4edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454950784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545759.299164:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf4edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876474454950784:12345-0@lo:400:kworker.0 Request processed in 150us (4842us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545759.299173:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789545759.299198:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789545759.299205:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454950400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545759.299233:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454950400:12345-0@lo:400:kworker.0 Request processed in 29us (4830us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545759.299238:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789545759.299829:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454950400:0@lo:400:kworker.0 00000100:00100000:2.0:1789545759.299849:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bd8d9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876474454950784:0@lo:400:kworker.0 00010000:00010000:2.0:1789545759.549179:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545759.805341:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be518ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454951040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789545759.805433:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545759.805600:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454951040 00000100:00100000:3.0:1789545759.805608:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454951040 00000100:00100000:3.0:1789545759.805647:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789545759.805655:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454951040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789545759.805686:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789545759.805740:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454951040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545759.805747:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789545759.805960:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454951168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789545759.806005:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545759.806012:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be518ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454951040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789545759.806075:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454951168 00000100:00100000:3.0:1789545759.806079:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454951168 00000100:00100000:3.0:1789545759.806156:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789545759.806165:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454951168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789545759.806187:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789545759.806274:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454951168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545759.806280:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789545759.806397:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454951168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789545760.184893:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545760.184948:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545760.184997:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545760.185026:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545760.185055:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545760.185091:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438191872 00000100:00100000:3.0:1789545760.185104:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438191872 00000100:00100000:3.0:1789545760.185185:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438191488 00000100:00100000:3.0:1789545760.185190:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438191488 00000100:00100000:3.0:1789545760.185221:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 162 00000100:00100000:3.0:1789545760.185233:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2359:x1876474438191872:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:3.0:1789545760.185331:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:2359:x1876474438191872:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 99us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545760.185338:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 162 00000100:00100000:3.0:1789545760.185400:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 163 00000100:00100000:3.0:1789545760.185409:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+20:2359:x1876474438191488:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:3.0:1789545760.185444:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+20:2359:x1876474438191488:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 37us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545760.185451:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 163 00000100:00080000:3.0:1789545760.185472:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789545760.185840:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438191360 00000100:00100000:1.0:1789545760.185848:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438191360 00000100:00100000:1.0:1789545760.185901:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 300 00000100:00100000:1.0:1789545760.185910:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2359:x1876474438191360:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545760.185953:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2359:x1876474438191360:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 44us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545760.185960:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 300 00000100:00100000:1.0:1789545760.186001:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438191616 00000100:00100000:1.0:1789545760.186006:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438191616 00000100:00100000:1.0:1789545760.186041:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438191744 00000100:00100000:1.0:1789545760.186044:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438191744 00000100:00100000:1.0:1789545760.186083:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 96 00000100:00100000:1.0:1789545760.186091:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+7:2359:x1876474438191616:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545760.186123:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+7:2359:x1876474438191616:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 33us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545760.186129:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 96 00000100:00100000:1.0:1789545760.186140:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 97 00000100:00100000:1.0:1789545760.186146:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+5:2359:x1876474438191744:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545760.186170:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a8edb7a-f384-4468-93f4-9d664f284862+5:2359:x1876474438191744:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 24us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545760.186175:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 97 00000100:00080000:1.0:1789545760.186265:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789545760.186269:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789545760.572457:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789545760.792974:0:12828:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 04:02:39 (1789545759) 00010000:00010000:2.0:1789545761.604287:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545762.620585:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789545763.045629:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545763.045851:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438192000 00000100:00100000:0.0:1789545763.045863:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438192000 00000100:00100000:0.0:1789545763.045943:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 238 00000100:00100000:0.0:1789545763.045954:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8d98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:347985d0-1f2a-4d4d-ae4d-f363a612744e+5:12340:x1876474438192000:12345-192.168.201.16@tcp:101:lsof.0 00010000:00010000:0.0:1789545763.045974:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545763.046010:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c15c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de57bb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545763.046084:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c15ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545763.046095:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c15ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545763.046102:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c15ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789545763.046131:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789545763.046134:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789545763.046171:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c15ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545763.046196:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6000/0x64919c0f856c15c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de57bb expref: 7 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545763.046211:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c15ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de57bb expref: 6 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545763.046217:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4ffe700) 00010000:00010000:0.0:1789545763.046219:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789545763.046222:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb6400, rc 0) 00000100:00100000:0.0:1789545763.046274:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8d98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:347985d0-1f2a-4d4d-ae4d-f363a612744e+6:12340:x1876474438192000:12345-192.168.201.16@tcp:101:lsof.0 Request processed in 324us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545763.046279:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 238 00000100:00080000:1.0:1789545763.046387:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789545763.430809:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1789545763.430822:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1789545763.430879:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1789545763.430890:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1789545763.645687:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789545764.415278:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789545764.415299:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876474454951552:0@lo:400:kworker.0 00000100:00100000:3.0:1789545764.415385:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545764.415451:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454951552 00000100:00100000:3.0:1789545764.415459:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454951552 00000100:00100000:3.0:1789545764.415509:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789545764.415532:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876474454951552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545764.415578:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876474454951552:12345-0@lo:400:kworker.0 Request processed in 48us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545764.415585:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:3.0:1789545764.415605:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789545764.415633:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876474454951552:0@lo:400:kworker.0 00000100:00100000:3.0:1789545764.415689:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454951680:0@lo:400:kworker.0 00000100:00100000:3.0:1789545764.415717:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545764.415761:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454951680 00000100:00100000:3.0:1789545764.415765:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454951680 00000100:00100000:1.0:1789545764.415780:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876474454951424:0@lo:400:kworker.0 00000100:00100000:3.0:1789545764.415808:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789545764.415820:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454951680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545764.415822:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545764.415855:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454951936:0@lo:400:kworker.0 00000100:00100000:3.0:1789545764.415872:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454951680:12345-0@lo:400:kworker.0 Request processed in 56us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545764.415879:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789545764.415885:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545764.415908:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789545764.415914:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be54d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454951296:0@lo:400:kworker.0 00000100:00100000:1.0:1789545764.415944:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545764.415970:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454951424 00000100:00100000:0.0:1789545764.415975:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454951424 00000100:00100000:0.0:1789545764.416012:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789545764.416018:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876474454951424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545764.416054:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876474454951424:12345-0@lo:400:kworker.0 Request processed in 36us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545764.416060:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789545764.416088:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454951808:0@lo:400:kworker.0 00000100:00100000:3.0:1789545764.416170:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454951936 00000100:00100000:3.0:1789545764.416179:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454951936 00000100:00100000:3.0:1789545764.416209:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789545764.416216:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454951936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545764.416250:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454951936:12345-0@lo:400:kworker.0 Request processed in 35us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545764.416256:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789545764.416355:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454951680:0@lo:400:kworker.0 00000100:00080000:3.0:1789545764.416408:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789545764.416411:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789545764.416429:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454951296 00000100:00100000:3.0:1789545764.416439:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454951296 00000100:00100000:3.0:1789545764.416467:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1789545764.416475:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3312:x1876474454951296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545764.416507:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3312:x1876474454951296:12345-0@lo:400:kworker.0 Request processed in 34us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545764.416513:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1789545764.416739:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545764.416766:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876474454951424:0@lo:400:kworker.0 00000100:00100000:1.0:1789545764.416776:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454951936:0@lo:400:kworker.0 00000100:00100000:1.0:1789545764.416791:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be54d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454951296:0@lo:400:kworker.0 00000100:00100000:3.0:1789545764.416832:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454951808 00000100:00100000:3.0:1789545764.416837:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454951808 00000100:00100000:3.0:1789545764.416876:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789545764.416883:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be518ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454951808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545764.416921:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be518ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454951808:12345-0@lo:400:kworker.0 Request processed in 38us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545764.416927:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789545764.416958:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454951808:0@lo:400:kworker.0 00000100:00080000:1.0:1789545764.417284:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789545764.631936:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545764.632051:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438192256 00000100:00100000:3.0:1789545764.632062:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438192256 00000100:00100000:3.0:1789545764.632178:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 66 00000100:00100000:3.0:1789545764.632189:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+19:12342:x1876474438192256:12345-192.168.201.16@tcp:35:umount.0 00000100:00100000:3.0:1789545764.632946:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+20:12342:x1876474438192256:12345-192.168.201.16@tcp:35:umount.0 Request processed in 755us (1017us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1789545764.632955:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 66 00000100:00080000:1.0:1789545764.633025:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789545764.636354:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545764.636465:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438192512 00000100:00100000:3.0:1789545764.636475:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438192512 00000100:00100000:3.0:1789545764.636713:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 67 00000100:00100000:3.0:1789545764.636724:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+20:12342:x1876474438192512:12345-192.168.201.16@tcp:35:umount.0 00000100:00100000:3.0:1789545764.637104:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+21:12342:x1876474438192512:12345-192.168.201.16@tcp:35:umount.0 Request processed in 380us (757us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1789545764.637125:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 67 00000100:00100000:0.0:1789545764.640254:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545764.640474:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438192768 00000100:00100000:1.0:1789545764.640595:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438192768 00000100:00100000:1.0:1789545764.640693:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 68 00000100:00100000:1.0:1789545764.640703:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd8cc4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+21:12342:x1876474438192768:12345-192.168.201.16@tcp:35:umount.0 00000100:00100000:1.0:1789545764.640978:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd8cc4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a8edb7a-f384-4468-93f4-9d664f284862+22:12342:x1876474438192768:12345-192.168.201.16@tcp:35:umount.0 Request processed in 276us (734us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1789545764.640987:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 68 00000100:00100000:0.0:1789545764.643393:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545764.643464:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438193024 00000100:00100000:3.0:1789545764.643474:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438193024 00000100:00100000:3.0:1789545764.643531:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 69 00000100:00100000:3.0:1789545764.643540:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+22:12342:x1876474438193024:12345-192.168.201.16@tcp:35:umount.0 00000100:00100000:3.0:1789545764.643869:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a8edb7a-f384-4468-93f4-9d664f284862+23:12342:x1876474438193024:12345-192.168.201.16@tcp:35:umount.0 Request processed in 328us (484us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1789545764.643876:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 69 00000100:00100000:2.0:1789545764.653253:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545764.653508:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438193152 00000100:00100000:0.0:1789545764.653520:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438193152 00000100:00100000:0.0:1789545764.653594:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 72 00000100:00100000:0.0:1789545764.653603:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a8edb7a-f384-4468-93f4-9d664f284862+5:2357:x1876474438193152:12345-192.168.201.16@tcp:9:umount.0 00000020:00000080:0.0:1789545764.653634:0:6692:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c092c 00000100:00080000:0.0:1789545764.653642:0:6692:0:(import.c:65:import_set_state_nolock()) ffff994bc2bc1800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789545764.653693:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1789545764.653958:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a8edb7a-f384-4468-93f4-9d664f284862+2:2357:x1876474438193152:12345-192.168.201.16@tcp:9:umount.0 Request processed in 354us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545764.653967:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 72 00000100:00080000:1.0:1789545764.654165:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789545764.655174:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545764.655894:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545764.655968:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545764.660225:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438193280 00000100:00100000:3.0:1789545764.660243:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438193280 00000100:00100000:3.0:1789545764.660449:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438193408 00000100:00100000:3.0:1789545764.660453:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438193408 00000100:00100000:1.0:1789545764.660996:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 16 00000100:00100000:1.0:1789545764.661009:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7941446-3286-4db8-8c2a-05ec7eed2433+14:2358:x1876474438193280:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789545764.661028:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545764.661047:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc0031600/0x64919c0f856c0654 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de534d expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545764.661063:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789545764.661130:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7941446-3286-4db8-8c2a-05ec7eed2433+13:2358:x1876474438193280:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 125us (5241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545764.661138:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 16 00000100:00100000:1.0:1789545764.661174:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 17 00000100:00100000:1.0:1789545764.661181:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7941446-3286-4db8-8c2a-05ec7eed2433+12:2360:x1876474438193408:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789545764.661190:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545764.661199:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bee11b400/0x64919c0f856c05ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5315 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545764.661207:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789545764.661226:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7941446-3286-4db8-8c2a-05ec7eed2433+11:2360:x1876474438193408:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 45us (5259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545764.661231:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 17 00000100:00100000:0.0:1789545764.665891:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545764.665933:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545764.665967:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438193792 00000100:00100000:3.0:1789545764.665977:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438193792 00000100:00100000:3.0:1789545764.666043:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 73 00000100:00100000:3.0:1789545764.666054:0:8211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a8edb7a-f384-4468-93f4-9d664f284862+7:2357:x1876474438193792:12345-192.168.201.16@tcp:9:umount.0 00000020:00000080:3.0:1789545764.666085:0:8211:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c0b94 00000020:00010000:3.0:1789545764.666092:0:8211:0:(genops.c:1920:obd_stale_export_put()) Put export ffff994bc2bc7800: total 0 00000100:00080000:3.0:1789545764.666097:0:8211:0:(import.c:65:import_set_state_nolock()) ffff994bc2bc1000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789545764.666139:0:8211:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1789545764.666451:0:8211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a8edb7a-f384-4468-93f4-9d664f284862+5:2357:x1876474438193792:12345-192.168.201.16@tcp:9:umount.0 Request processed in 397us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545764.666459:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 73 00000020:00010000:3.0:1789545764.666684:0:5835:0:(genops.c:1906:obd_stale_export_get()) Get export ffff994bc2bc7800: total 0 00010000:00010000:3.0:1789545764.666707:0:5835:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff994bc2bc7800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1789545764.666755:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000712e86a3/0x64919c0f856c15c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de57b4 expref: 4 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545764.666813:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048144db1/0x64919c0f856c0f30 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55ed expref: 3 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545764.666827:0:5835:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff994bc2bc7800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1789545764.666840:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545764.666842:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545764.666843:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789545764.667198:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789545764.674350:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438193920 00000100:00100000:3.0:1789545764.674379:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438193920 00000100:00100000:0.0:1789545764.674772:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 18 00000100:00100000:0.0:1789545764.674785:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7941446-3286-4db8-8c2a-05ec7eed2433+11:2359:x1876474438193920:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789545764.674801:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789545764.674822:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc49d1800/0x64919c0f856c0868 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5418 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545764.674860:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789545764.674924:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7941446-3286-4db8-8c2a-05ec7eed2433+10:2359:x1876474438193920:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 142us (8988us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545764.674932:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 18 00000100:00100000:0.0:1789545764.675903:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545764.676081:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438194944 00000100:00100000:3.0:1789545764.676088:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438194944 00000100:00100000:3.0:1789545764.676127:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 239 00000100:00100000:3.0:1789545764.676134:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+23:2357:x1876474438194944:12345-192.168.201.16@tcp:39:umount.0 00000020:00000080:3.0:1789545764.676164:0:5848:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c05c8 00000020:00010000:3.0:1789545764.676178:0:5848:0:(genops.c:1920:obd_stale_export_put()) Put export ffff994ac21c1800: total 0 00000100:00080000:3.0:1789545764.676183:0:5848:0:(import.c:65:import_set_state_nolock()) ffff994be47a1800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789545764.676207:0:5848:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:1.0:1789545764.677068:0:5834:0:(genops.c:1906:obd_stale_export_get()) Get export ffff994ac21c1800: total 0 00010000:00010000:1.0:1789545764.677114:0:5834:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff994ac21c1800, canceled 0 locks, left on hash table 14. 00010000:00010000:1.0:1789545764.677142:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:1.0:1789545764.677145:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789545764.677155:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c0bef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5514 expref: 22 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545764.677177:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff994bc4f11d00) 00010000:00010000:1.0:1789545764.677179:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789545764.677184:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7a00/0x64919c0f856c0892 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5426 expref: 21 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545764.677202:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:1.0:1789545764.677205:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789545764.677210:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fe00/0x64919c0f856c0f1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55e6 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545764.677224:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:1.0:1789545764.677240:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789545764.677245:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fc00/0x64919c0f856c0e11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55a0 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545764.677328:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a8edb7a-f384-4468-93f4-9d664f284862+18:2357:x1876474438194944:12345-192.168.201.16@tcp:39:umount.0 Request processed in 1192us (1426us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1789545764.677338:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 239 00010000:00010000:3.0:1789545764.677385:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545764.678211:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f11b00) 00010000:00010000:1.0:1789545764.678217:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789545764.678224:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1573 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de579f expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545764.678242:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:1.0:1789545764.678245:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789545764.678249:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7e00/0x64919c0f856c0902 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5442 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545764.678344:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4ffe700) 00010000:00010000:1.0:1789545764.678347:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789545764.678352:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9600/0x64919c0f856c0f84 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5602 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545764.678385:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f11b00) 00010000:00010000:1.0:1789545764.678387:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789545764.678391:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0c00/0x64919c0f856c15ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de57ad expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545764.678402:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff994bc4f11700) 00010000:00010000:1.0:1789545764.678404:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545764.678408:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7600/0x64919c0f856c08ae lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de542d expref: 13 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545764.678440:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:1.0:1789545764.678443:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789545764.678446:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217fa00/0x64919c0f856c127f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de56db expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545764.678458:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f11b00) 00010000:00010000:1.0:1789545764.678460:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789545764.678463:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6600/0x64919c0f856c159d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de57a6 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545764.678472:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994bc4f11800) 00010000:00010000:1.0:1789545764.678474:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789545764.678658:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7400/0x64919c0f856c0fa0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5609 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545764.678689:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994bc4f11a00) 00010000:00010000:1.0:1789545764.678692:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789545764.678696:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994c0217f400/0x64919c0f856c0ef1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de55d8 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545764.678712:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994bc4f11b00) 00010000:00010000:1.0:1789545764.678714:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789545764.678717:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9c00/0x64919c0f856c14a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5767 expref: 8 pid: 10125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545764.678728:0:5834:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff994ac21c1800, canceled 14 locks, left on hash table 0. 00010000:00010000:1.0:1789545764.678752:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545764.678759:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545764.678761:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545764.925839:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789545764.927294:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be3a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454952192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789545764.927383:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545764.927517:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454952064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789545764.927544:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545764.927616:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454952192 00000100:00100000:3.0:1789545764.927625:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454952192 00000100:00100000:3.0:1789545764.927666:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454952064 00000100:00100000:3.0:1789545764.927679:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454952064 00000100:00100000:3.0:1789545764.927700:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789545764.927712:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454952192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789545764.927769:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789545764.927825:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454952192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545764.927832:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789545764.927863:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789545764.927877:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454952064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789545764.927895:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789545764.927923:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454952064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545764.927929:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789545764.934327:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454952064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789545764.934413:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be3a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454952192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789545765.298309:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545765.298356:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545765.298490:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438195200 00000100:00100000:1.0:1789545765.298501:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438195200 00000100:00100000:1.0:1789545765.298582:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 167 00000100:00100000:1.0:1789545765.298592:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:347985d0-1f2a-4d4d-ae4d-f363a612744e+6:2358:x1876474438195200:12345-192.168.201.16@tcp:400:kworker.0 00000100:00080000:2.0:1789545765.298607:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789545765.298683:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:347985d0-1f2a-4d4d-ae4d-f363a612744e+6:2358:x1876474438195200:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 92us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545765.298691:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 167 00000100:00100000:3.0:1789545765.299149:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438195072 00000100:00100000:3.0:1789545765.299155:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438195072 00000100:00100000:3.0:1789545765.299197:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 302 00000100:00100000:3.0:1789545765.299205:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+10:2358:x1876474438195072:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:3.0:1789545765.299258:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7941446-3286-4db8-8c2a-05ec7eed2433+10:2358:x1876474438195072:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 53us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545765.299265:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 302 00010000:00010000:3.0:1789545765.692869:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789545766.716696:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789545766.716708:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789545766.717146:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1789545766.717154:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789545766.717785:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545766.961348:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545766.961420:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545766.961655:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438195328 00000100:00100000:1.0:1789545766.961670:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438195328 00000100:00100000:1.0:1789545766.961741:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438195584 00000100:00100000:1.0:1789545766.961744:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438195584 00000100:00100000:1.0:1789545766.961770:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 19 00000100:00100000:1.0:1789545766.961780:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4798700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7941446-3286-4db8-8c2a-05ec7eed2433+11:2358:x1876474438195328:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789545766.961800:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545766.961823:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc8ba9a00/0x64919c0f856c069a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5362 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545766.961863:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789545766.961927:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4798700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7941446-3286-4db8-8c2a-05ec7eed2433+10:2358:x1876474438195328:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 147us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545766.961935:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 19 00000100:00100000:1.0:1789545766.961954:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 20 00000100:00100000:1.0:1789545766.961961:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4798a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7941446-3286-4db8-8c2a-05ec7eed2433+9:2358:x1876474438195584:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789545766.961971:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545766.961980:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994c0217e200/0x64919c0f856c0861 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5411 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545766.961990:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789545766.962008:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4798a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c7941446-3286-4db8-8c2a-05ec7eed2433+8:2358:x1876474438195584:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 48us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545766.962014:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 20 00000100:00100000:0.0:1789545766.962804:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545766.962883:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438195456 00000100:00100000:2.0:1789545766.962891:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438195456 00000100:00100000:2.0:1789545766.962938:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 21 00000100:00100000:2.0:1789545766.962948:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4799500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7941446-3286-4db8-8c2a-05ec7eed2433+8:2358:x1876474438195456:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789545766.962960:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545766.962973:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc0031a00/0x64919c0f856c06a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de538c expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545766.963001:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789545766.963046:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4799500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7941446-3286-4db8-8c2a-05ec7eed2433+7:2358:x1876474438195456:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 100us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545766.963060:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 21 00000100:00100000:1.0:1789545766.976167:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545766.976688:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438195840 00000100:00100000:3.0:1789545766.976699:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438195840 00000100:00100000:3.0:1789545766.976790:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 240 00000100:00100000:3.0:1789545766.976801:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:347985d0-1f2a-4d4d-ae4d-f363a612744e+6:2357:x1876474438195840:12345-192.168.201.16@tcp:39:umount.0 00000020:00000080:3.0:1789545766.976842:0:5848:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c06af 00000020:00010000:3.0:1789545766.976853:0:5848:0:(genops.c:1920:obd_stale_export_put()) Put export ffff994be4c9a000: total 0 00000100:00080000:3.0:1789545766.976858:0:5848:0:(import.c:65:import_set_state_nolock()) ffff994be4c9d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789545766.976902:0:5848:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:1.0:1789545766.977202:0:5834:0:(genops.c:1906:obd_stale_export_get()) Get export ffff994be4c9a000: total 0 00010000:00010000:1.0:1789545766.977207:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545766.977250:0:5834:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff994be4c9a000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789545766.977283:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4ffe700) 00010000:00010000:1.0:1789545766.977287:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789545766.977295:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c15ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de57bb expref: 6 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545766.977319:0:5834:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff994be4c9a000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789545766.977328:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545766.977330:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545766.977338:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789545766.977742:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:347985d0-1f2a-4d4d-ae4d-f363a612744e+3:2357:x1876474438195840:12345-192.168.201.16@tcp:39:umount.0 Request processed in 940us (1585us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1789545766.977753:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 240 00000100:00100000:0.0:1789545767.026091:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545767.026176:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438196096 00000100:00100000:3.0:1789545767.026188:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438196096 00000100:00100000:3.0:1789545767.026257:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 303 00000100:00100000:3.0:1789545767.026268:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bede2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+7:2357:x1876474438196096:12345-192.168.201.16@tcp:251:umount.0 00000020:00000080:3.0:1789545767.026318:0:5838:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c05a5 00000020:00010000:3.0:1789545767.026326:0:5838:0:(genops.c:1920:obd_stale_export_put()) Put export ffff994ac21c5800: total 0 00000100:00080000:3.0:1789545767.026331:0:5838:0:(import.c:65:import_set_state_nolock()) ffff994ac21c3800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789545767.026438:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bede2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7941446-3286-4db8-8c2a-05ec7eed2433+3:2357:x1876474438196096:12345-192.168.201.16@tcp:251:umount.0 Request processed in 172us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545767.026446:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 303 00000020:00010000:0.0:1789545767.026551:0:5835:0:(genops.c:1906:obd_stale_export_get()) Get export ffff994ac21c5800: total 0 00010000:00010000:0.0:1789545767.026598:0:5835:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff994ac21c5800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789545767.026650:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc0031400/0x64919c0f856c065b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5354 expref: 2 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545767.026664:0:5835:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff994ac21c5800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1789545767.026675:0:5835:0:(genops.c:885:class_export_put()) final put ffff994ac21c5800/c7941446-3286-4db8-8c2a-05ec7eed2433 00010000:00010000:0.0:1789545767.026691:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545767.026694:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545767.026695:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789545767.026946:0:12196:0:(genops.c:844:class_export_destroy()) destroying export ffff994ac21c5800/c7941446-3286-4db8-8c2a-05ec7eed2433 for MGS 00000020:00000080:3.0:1789545767.029690:0:12196:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff994ac21c3800 for MGS 00010000:00010000:3.0:1789545767.740791:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789545768.598502:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8a8edb7a-f384-4468-93f4-9d664f284862 00000020:00000080:1.0:1789545768.598515:0:6717:0:(genops.c:885:class_export_put()) final put ffff994bc2bc7800/8a8edb7a-f384-4468-93f4-9d664f284862 00000020:00000080:0.0:1789545768.598637:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff994bc2bc7800/8a8edb7a-f384-4468-93f4-9d664f284862 for lustre-OST0000 00000020:00000080:0.0:1789545768.598714:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff994bc2bc1000 for lustre-OST0000 00000001:00080000:3.0:1789545768.622178:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:1.0:1789545768.622445:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 347985d0-1f2a-4d4d-ae4d-f363a612744e 00000001:00080000:1.0:1789545768.622456:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1789545768.622460:0:5868:0:(genops.c:885:class_export_put()) final put ffff994be4c9a000/347985d0-1f2a-4d4d-ae4d-f363a612744e 00000001:00100000:1.0:1789545768.622478:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8a8edb7a-f384-4468-93f4-9d664f284862 00000001:00080000:1.0:1789545768.622484:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1789545768.622494:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff994be4c9a000/347985d0-1f2a-4d4d-ae4d-f363a612744e for lustre-MDT0000 00000020:00000080:1.0:1789545768.622505:0:5868:0:(genops.c:885:class_export_put()) final put ffff994ac21c1800/8a8edb7a-f384-4468-93f4-9d664f284862 00000020:00000080:3.0:1789545768.631024:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff994be4c9d800 for lustre-MDT0000 00000020:00000080:3.0:1789545768.631045:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff994ac21c1800/8a8edb7a-f384-4468-93f4-9d664f284862 for lustre-MDT0000 00000020:00000080:3.0:1789545768.631253:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff994be47a1800 for lustre-MDT0000 00010000:00010000:1.0:1789545768.764839:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789545768.999379:0:13026:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789545769.008872:0:13026:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1789545769.008919:0:13026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8a00/0x64919c0f856c062a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0631 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545769.008935:0:13026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8a00/0x64919c0f856c062a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c0631 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545769.008943:0:13026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8a00/0x64919c0f856c062a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x64919c0f856c0631 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545769.008950:0:13026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8a00/0x64919c0f856c062a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x64919c0f856c0631 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545769.008975:0:13026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789545769.008981:0:13026:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789545769.009002:0:13026:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789545769.009006:0:13026:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789545769.009012:0:13026:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789545769.009037:0:13026:0:(import.c:65:import_set_state_nolock()) ffff994beccfd800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1789545769.009160:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789545769.009168:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8a00/0x64919c0f856c062a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x64919c0f856c0631 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545769.009176:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba8a00 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:3.0:1789545769.009191:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8a00/0x64919c0f856c062a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x64919c0f856c0631 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545769.009200:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8a00/0x64919c0f856c062a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x64919c0f856c0631 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789545769.009208:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8a00/0x64919c0f856c062a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x64919c0f856c0631 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789545769.009214:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789545769.009217:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789545769.009220:0:5835:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789545769.009250:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8a00/0x64919c0f856c062a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x64919c0f856c0631 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545769.009257:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789545769.009286:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8a00/0x64919c0f856c062a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x64919c0f856c0631 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545769.009294:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8a00/0x64919c0f856c062a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x64919c0f856c0631 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545769.009306:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545769.009308:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545769.009310:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789545769.009317:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789545769.009335:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454952448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789545769.009426:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545769.009493:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454952448 00000100:00100000:3.0:1789545769.009500:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454952448 00000100:00100000:3.0:1789545769.009549:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789545769.009568:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd9365450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:beb86ab1-4563-44b1-afd1-f08a43b0622e+19:3312:x1876474454952448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789545769.009583:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545769.009606:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994c0217e800/0x64919c0f856c0631 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x64919c0f856c062a expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545769.009619:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545769.009653:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd9365450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:3312:x1876474454952448:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545769.009659:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789545769.009742:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454952448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789545769.017792:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876474454952320:0@lo:39:umount.0 00000100:00100000:2.0:1789545769.018729:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545769.018814:0:10125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454952320 00000100:00100000:2.0:1789545769.018822:0:10125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454952320 00000100:00100000:2.0:1789545769.018876:0:10125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789545769.018885:0:10125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876474454952320:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789545769.018919:0:10125:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c03b4 00000100:00080000:2.0:1789545769.018929:0:10125:0:(import.c:65:import_set_state_nolock()) ffff994bffa7a000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789545769.019003:0:10125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3310:x1876474454952320:12345-0@lo:39:umount.0 Request processed in 120us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545769.019011:0:10125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:2.0:1789545769.019021:0:10125:0:(genops.c:885:class_export_put()) final put ffff994bffa7b000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1789545769.019064:0:3310:0:(import.c:65:import_set_state_nolock()) ffff994beccfd800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789545769.019075:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876474454952320:0@lo:39:umount.0 00000020:00000080:0.0:1789545769.019078:0:12196:0:(genops.c:844:class_export_destroy()) destroying export ffff994bffa7b000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789545769.019126:0:12196:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff994bffa7a000 for lustre-MDT0000 00000100:00080000:1.0:1789545769.020955:0:13026:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789545769.020976:0:13026:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789545769.020985:0:13026:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789545769.021134:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545769.023049:0:13026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994c0217f800/0x64919c0f856c0638 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c063f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545769.026251:0:13026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994c0217f800/0x64919c0f856c0638 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c063f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545769.026310:0:13026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994c0217f800/0x64919c0f856c0638 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x64919c0f856c063f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545769.026317:0:13026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.116@tcp lock: ffff994c0217f800/0x64919c0f856c0638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x64919c0f856c063f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545769.026427:0:13026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789545769.026436:0:13026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bee11bc00/0x64919c0f856c055f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0566 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545769.026443:0:13026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bee11bc00/0x64919c0f856c055f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c0566 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545769.026450:0:13026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bee11bc00/0x64919c0f856c055f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x64919c0f856c0566 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545769.026456:0:13026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.116@tcp lock: ffff994bee11bc00/0x64919c0f856c055f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x64919c0f856c0566 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545769.026512:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789545769.026522:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994c0217f800/0x64919c0f856c0638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x64919c0f856c063f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545769.026528:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217f800 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:2.0:1789545769.026532:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994c0217f800/0x64919c0f856c0638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x64919c0f856c063f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545769.026560:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994c0217f800/0x64919c0f856c0638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x64919c0f856c063f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789545769.026568:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994c0217f800/0x64919c0f856c0638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x64919c0f856c063f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789545769.026573:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789545769.026576:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1789545769.026630:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994c0217f800/0x64919c0f856c0638 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x64919c0f856c063f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545769.026636:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789545769.026676:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994c0217f800/0x64919c0f856c0638 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x64919c0f856c063f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545769.026684:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994c0217f800/0x64919c0f856c0638 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x64919c0f856c063f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545769.026702:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789545769.026705:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bee11bc00/0x64919c0f856c055f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x64919c0f856c0566 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545769.026710:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bee11bc00 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:2.0:1789545769.026713:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bee11bc00/0x64919c0f856c055f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x64919c0f856c0566 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545769.026720:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bee11bc00/0x64919c0f856c055f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x64919c0f856c0566 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789545769.026725:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bee11bc00/0x64919c0f856c055f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x64919c0f856c0566 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789545769.026737:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789545769.026739:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1789545769.026753:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bee11bc00/0x64919c0f856c055f lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x64919c0f856c0566 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545769.026758:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789545769.026777:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bee11bc00/0x64919c0f856c055f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x64919c0f856c0566 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545769.026784:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545769.026786:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545769.026788:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545769.026797:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789545769.026819:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be3a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beb86ab1-4563-44b1-afd1-f08a43b0622e:3314:1876474454952704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789545769.026901:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545769.026973:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454952704 00000100:00100000:2.0:1789545769.026982:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454952704 00000100:00100000:2.0:1789545769.027052:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789545769.027063:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:beb86ab1-4563-44b1-afd1-f08a43b0622e+18:3314:x1876474454952704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789545769.027077:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545769.027092:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994c0217ea00/0x64919c0f856c0566 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x64919c0f856c055f expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545769.027108:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789545769.027144:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:3314:x1876474454952704:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545769.027152:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789545769.027960:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be3a9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454952576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789545769.028004:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545769.028051:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454952576 00000100:00100000:3.0:1789545769.028056:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454952576 00000100:00100000:3.0:1789545769.028092:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789545769.028100:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:beb86ab1-4563-44b1-afd1-f08a43b0622e+17:3312:x1876474454952576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789545769.028110:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545769.028122:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc8ba8000/0x64919c0f856c063f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x64919c0f856c0638 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545769.028147:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545769.028180:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:3312:x1876474454952576:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545769.028186:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789545769.028226:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be3a9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454952576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789545769.028291:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be3a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beb86ab1-4563-44b1-afd1-f08a43b0622e:3314:1876474454952704:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789545769.028471:0:13026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789545769.028480:0:13026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bee11bc00/0x64919c0f856c055f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x64919c0f856c0566 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789545769.028505:0:13026:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1789545769.028514:0:13026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994be4eb6e00/0x64919c0f856c0853 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c085a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545769.028521:0:13026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994be4eb6e00/0x64919c0f856c0853 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c085a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545769.028528:0:13026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994be4eb6e00/0x64919c0f856c0853 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x64919c0f856c085a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545769.028535:0:13026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.116@tcp lock: ffff994be4eb6e00/0x64919c0f856c0853 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x64919c0f856c085a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545769.028565:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789545769.028576:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994be4eb6e00/0x64919c0f856c0853 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x64919c0f856c085a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545769.028583:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6e00 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:0.0:1789545769.028586:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994be4eb6e00/0x64919c0f856c0853 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x64919c0f856c085a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545769.028593:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994be4eb6e00/0x64919c0f856c0853 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x64919c0f856c085a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789545769.028610:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994be4eb6e00/0x64919c0f856c0853 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x64919c0f856c085a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789545769.028615:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789545769.028617:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1789545769.028637:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994be4eb6e00/0x64919c0f856c0853 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x64919c0f856c085a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545769.028643:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789545769.028676:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994be4eb6e00/0x64919c0f856c0853 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x64919c0f856c085a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545769.028685:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545769.028687:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545769.028689:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545769.028723:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be479b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beb86ab1-4563-44b1-afd1-f08a43b0622e:3314:1876474454952832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789545769.028754:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545769.028871:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454952832 00000100:00100000:0.0:1789545769.028876:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454952832 00000100:00100000:0.0:1789545769.028910:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789545769.028918:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+16:3314:x1876474454952832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789545769.028927:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789545769.028937:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994be4eb6a00/0x64919c0f856c085a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x64919c0f856c0853 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545769.028959:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789545769.029002:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:3314:x1876474454952832:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545769.029009:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789545769.029395:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be479b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beb86ab1-4563-44b1-afd1-f08a43b0622e:3314:1876474454952832:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789545769.030240:0:13026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789545769.030250:0:13026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994be4eb6e00/0x64919c0f856c0853 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x64919c0f856c085a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789545769.030263:0:13026:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789545769.030273:0:13026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d1a00/0x64919c0f856c0313 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c031a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545769.030280:0:13026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d1a00/0x64919c0f856c0313 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c031a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545769.030286:0:13026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d1a00/0x64919c0f856c0313 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x64919c0f856c031a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545769.030291:0:13026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.116@tcp lock: ffff994bc49d1a00/0x64919c0f856c0313 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x64919c0f856c031a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545769.030337:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789545769.030343:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bc49d1a00/0x64919c0f856c0313 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x64919c0f856c031a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545769.030350:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1a00 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:0.0:1789545769.030354:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bc49d1a00/0x64919c0f856c0313 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x64919c0f856c031a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545769.030383:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bc49d1a00/0x64919c0f856c0313 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x64919c0f856c031a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789545769.030389:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bc49d1a00/0x64919c0f856c0313 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x64919c0f856c031a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789545769.030394:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789545769.030397:0:8453:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:0.0:1789545769.030421:0:8453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bc49d1a00/0x64919c0f856c0313 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x64919c0f856c031a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545769.030427:0:8453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789545769.030451:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bc49d1a00/0x64919c0f856c0313 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x64919c0f856c031a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545769.030458:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545769.030460:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545769.030468:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545769.030522:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be479b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454952960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789545769.030568:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545769.030741:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454952960 00000100:00100000:0.0:1789545769.030748:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454952960 00000100:00100000:0.0:1789545769.030797:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789545769.030805:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:beb86ab1-4563-44b1-afd1-f08a43b0622e+15:3311:x1876474454952960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789545769.030818:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789545769.030831:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bee11a800/0x64919c0f856c031a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x64919c0f856c0313 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545769.030845:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789545769.030885:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:beb86ab1-4563-44b1-afd1-f08a43b0622e+14:3311:x1876474454952960:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545769.030892:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789545769.030926:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be479b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454952960:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789545769.031051:0:13026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789545769.031056:0:13026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bc49d1a00/0x64919c0f856c0313 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x64919c0f856c031a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789545769.031068:0:13026:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:1.0:1789545769.031072:0:13026:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1789545769.031074:0:13026:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1789545769.031103:0:13026:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1789545769.031107:0:13026:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1789545769.031111:0:13026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789545769.031116:0:13026:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1789545769.031121:0:13026:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff994bdfcb5800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789545769.031257:0:13026:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff994bdf93d800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789545769.031262:0:13026:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff994bd083b380) has exports, disconnecting them 00000020:00080000:1.0:1789545769.031266:0:13026:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff994bdfcb5800), last request at 1789545764 00000020:00000080:1.0:1789545769.031273:0:13026:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c0527 00000100:00080000:1.0:1789545769.031291:0:13026:0:(import.c:65:import_set_state_nolock()) ffff994be4c9b000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789545769.031317:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789545769.031482:0:13026:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff994bdfcb5800): rc 0 00000020:00000080:1.0:1789545769.031485:0:13026:0:(genops.c:885:class_export_put()) final put ffff994bdfcb5800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1789545769.031498:0:13026:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff994bdf93d800), last request at 1789545764 00000020:00000080:1.0:1789545769.031502:0:13026:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c045c 00000020:00000080:3.0:1789545769.031506:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff994bdfcb5800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00080000:1.0:1789545769.031509:0:13026:0:(import.c:65:import_set_state_nolock()) ffff994bdf93a000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789545769.031550:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff994be4c9b000 for lustre-MDT0000 00010000:00010000:0.0:1789545769.031960:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789545769.032028:0:13026:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff994bdf93d800): rc 0 00000020:00000080:1.0:1789545769.032030:0:13026:0:(genops.c:885:class_export_put()) final put ffff994bdf93d800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1789545769.032046:0:13026:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa45002bd3ae0 00000100:00080000:1.0:1789545769.032066:0:13026:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789545769.032070:0:13026:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000020:00000080:3.0:1789545769.032099:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff994bdf93d800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000004:00080000:1.0:1789545769.032133:0:13026:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:3.0:1789545769.032141:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff994bdf93a000 for lustre-MDT0000 00000100:00080000:1.0:1789545769.032278:0:13026:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789545769.032296:0:13026:0:(import.c:65:import_set_state_nolock()) ffff994bfbcfe800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1789545769.032319:0:13026:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789545769.032322:0:13026:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1789545769.032334:0:13026:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789545769.032421:0:13026:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1789545769.032430:0:13026:0:(import.c:65:import_set_state_nolock()) ffff994bdf6c8000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789545769.032455:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876474454953088:0@lo:9:umount.0 00000020:00080000:1.0:1789545769.032459:0:13026:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff994bd083b380) has no exports 00000100:00100000:3.0:1789545769.032504:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545769.032541:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876474454953216:0@lo:9:umount.0 00000100:00100000:3.0:1789545769.032559:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545769.032594:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454953088 00000100:00100000:3.0:1789545769.032612:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454953088 00000100:00100000:3.0:1789545769.032661:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454953216 00000100:00100000:3.0:1789545769.032665:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454953216 00000100:00100000:3.0:1789545769.032700:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789545769.032709:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876474454953088:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789545769.032731:0:6692:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c04b0 00000100:00080000:3.0:1789545769.032737:0:6692:0:(import.c:65:import_set_state_nolock()) ffff994bdf6ce800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789545769.033158:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789545769.033168:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876474454953216:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789545769.033248:0:6693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c0590 00000100:00080000:1.0:1789545769.033256:0:6693:0:(import.c:65:import_set_state_nolock()) ffff994be4c9a800 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1789545769.035938:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789545769.035947:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789545769.037558:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545769.046700:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1789545769.046758:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000001:00000004:1.0:1789545769.047396:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1789545769.047437:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3310:x1876474454953088:12345-0@lo:9:umount.0 Request processed in 14725us (14928us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545769.047450:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789545769.047498:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3310:x1876474454953216:12345-0@lo:9:umount.0 Request processed in 14332us (14936us total) trans 0 rc 0/0 00000100:00080000:3.0:1789545769.047499:0:3310:0:(import.c:65:import_set_state_nolock()) ffff994bfbcfe800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789545769.047505:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:3.0:1789545769.047512:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789545769.047514:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789545769.047517:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876474454953088:0@lo:9:umount.0 00000100:00080000:3.0:1789545769.047530:0:3310:0:(import.c:65:import_set_state_nolock()) ffff994bdf6c8000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789545769.047543:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789545769.047545:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789545769.047561:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876474454953216:0@lo:9:umount.0 00010000:00010000:0.0:1789545769.047606:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789545769.053739:0:13026:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff994bd083b380) has no exports 00000020:00000080:0.0:1789545769.115322:0:13026:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c036e 00000020:00000080:0.0:1789545769.115339:0:13026:0:(genops.c:885:class_export_put()) final put ffff994be52ae000/lustre-QMT0000_UUID 00000020:01000000:0.0:1789545769.115437:0:13026:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789545769.115748:0:12196:0:(genops.c:844:class_export_destroy()) destroying export ffff994be52ae000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1789545769.115796:0:13026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789545769.115807:0:13026:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789545769.115812:0:13026:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff994be75a99c0) has no exports 00000020:00000080:1.0:1789545769.116254:0:13026:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c0367 00000020:00000080:1.0:1789545769.116261:0:13026:0:(genops.c:885:class_export_put()) final put ffff994be75bf800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789545769.116317:0:12196:0:(genops.c:844:class_export_destroy()) destroying export ffff994be75bf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789545769.116548:0:13026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789545769.116557:0:13026:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789545769.116561:0:13026:0:(genops.c:885:class_export_put()) final put ffff994be54f1000/lustre-QMT0000_UUID 00000020:00000080:1.0:1789545769.116563:0:13026:0:(genops.c:844:class_export_destroy()) destroying export ffff994be54f1000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1789545769.116572:0:13026:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1789545769.116725:0:13026:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff994bd8c398a0 - data ffff994bdffa10d8/ffff994be4f7ec00 00000020:01000000:1.0:1789545769.116875:0:13026:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff994bd8c609c0 - data ffff994c007d0000/ffff994be6038400 00000001:00000004:1.0:1789545769.133546:0:13026:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1789545769.189820:0:13026:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789545769.189830:0:13026:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1789545769.189853:0:13026:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789545769.189857:0:13026:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789545769.190485:0:6808:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789545769.190491:0:6808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1789545769.190500:0:6808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789545769.191683:0:13026:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789545769.191689:0:13026:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1789545769.191707:0:13026:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789545769.191709:0:13026:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789545769.192416:0:7962:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789545769.192421:0:7962:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1789545769.192431:0:7962:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1789545769.260624:0:13026:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c0336 00000020:00000080:1.0:1789545769.260638:0:13026:0:(genops.c:885:class_export_put()) final put ffff994bffa7e800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789545769.261322:0:12196:0:(genops.c:844:class_export_destroy()) destroying export ffff994bffa7e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789545769.263140:0:13026:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c034b 00000020:00000080:0.0:1789545769.263154:0:13026:0:(genops.c:885:class_export_put()) final put ffff994be54f3000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789545769.263887:0:13026:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1789545769.263897:0:13026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789545769.263906:0:13026:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789545769.263922:0:13026:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff994bd083cd40) has no exports 00000004:01000000:0.0:1789545769.264094:0:13026:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789545769.264103:0:13026:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c0589 00000020:00000080:0.0:1789545769.264109:0:13026:0:(genops.c:885:class_export_put()) final put ffff994ac21c5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789545769.264155:0:12196:0:(genops.c:844:class_export_destroy()) destroying export ffff994be54f3000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789545769.264268:0:13026:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789545769.264273:0:13026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789545769.264280:0:13026:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789545769.264282:0:13026:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff994bc65db380) has no exports 00000020:00000080:0.0:1789545769.264289:0:13026:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c0582 00000020:00000080:0.0:1789545769.264293:0:13026:0:(genops.c:885:class_export_put()) final put ffff994becda6800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789545769.264418:0:12196:0:(genops.c:844:class_export_destroy()) destroying export ffff994ac21c5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1789545769.264838:0:13026:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789545769.264843:0:13026:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789545769.264846:0:13026:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1789545769.264851:0:13026:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789545769.264853:0:13026:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789545769.264930:0:12196:0:(genops.c:844:class_export_destroy()) destroying export ffff994becda6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789545769.265015:0:13026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789545769.265024:0:13026:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789545769.265030:0:13026:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c04a2 00000020:00000080:0.0:1789545769.265035:0:13026:0:(genops.c:885:class_export_put()) final put ffff994bc4be9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789545769.265053:0:12196:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff994bdf6c8000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789545769.265058:0:12196:0:(genops.c:885:class_export_put()) final put ffff994becda3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789545769.265060:0:12196:0:(genops.c:844:class_export_destroy()) destroying export ffff994becda3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1789545769.265065:0:12196:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789545769.265249:0:13026:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789545769.265253:0:13026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789545769.265258:0:13026:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789545769.265272:0:13026:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff994be40acd40) has no exports 00000020:00000080:0.0:1789545769.265276:0:13026:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c049b 00000020:00000080:0.0:1789545769.265279:0:13026:0:(genops.c:885:class_export_put()) final put ffff994bfbcfd000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789545769.265507:0:12196:0:(genops.c:844:class_export_destroy()) destroying export ffff994bc4be9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:0.0:1789545769.266913:0:13026:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789545769.266920:0:13026:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789545769.266923:0:13026:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1789545769.266929:0:13026:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789545769.266931:0:13026:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789545769.267849:0:12196:0:(genops.c:844:class_export_destroy()) destroying export ffff994bfbcfd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789545769.268404:0:13026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789545769.268416:0:13026:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789545769.268455:0:13026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789545769.268488:0:12196:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff994bfbcfe800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789545769.268497:0:12196:0:(genops.c:885:class_export_put()) final put ffff994bfbcf9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789545769.268500:0:12196:0:(genops.c:844:class_export_destroy()) destroying export ffff994bfbcf9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1789545769.268505:0:12196:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789545769.268572:0:13026:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789545769.268576:0:13026:0:(genops.c:885:class_export_put()) final put ffff994bffa79000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789545769.268578:0:13026:0:(genops.c:844:class_export_destroy()) destroying export ffff994bffa79000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789545769.268583:0:13026:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789545769.268912:0:13026:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c0352 00000020:00000080:0.0:1789545769.268920:0:13026:0:(genops.c:885:class_export_put()) final put ffff994be54f5000/lustre-MDD0000_UUID 00000020:01000000:0.0:1789545769.268934:0:13026:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789545769.268939:0:13026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789545769.268944:0:13026:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789545769.268948:0:13026:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff994bd0838000) has no exports 00000020:00000080:0.0:1789545769.268967:0:13026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789545769.268970:0:13026:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789545769.268974:0:13026:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c0359 00000020:00000080:0.0:1789545769.268978:0:13026:0:(genops.c:885:class_export_put()) final put ffff994be54f6800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789545769.268986:0:13026:0:(tgt_mount.c:187:server_put_mount()) put mount ffff994bc4a49800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789545769.268989:0:13026:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994bc4a49800 3 00000020:01000004:0.0:1789545769.268992:0:13026:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff994bc4a49800 from lustre-MDT0000 00000020:00000080:0.0:1789545769.269012:0:13026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789545769.269016:0:13026:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789545769.269019:0:13026:0:(genops.c:885:class_export_put()) final put ffff994bffa7c800/lustre-MDT0000_UUID 00000020:00000080:0.0:1789545769.269021:0:13026:0:(genops.c:844:class_export_destroy()) destroying export ffff994bffa7c800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789545769.269028:0:13026:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789545769.269052:0:13026:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1789545769.269056:0:13026:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789545769.269059:0:13026:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789545769.269061:0:13026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789545769.269064:0:13026:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789545769.269070:0:13026:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff994bc9cea000 beb86ab1-4563-44b1-afd1-f08a43b0622e 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789545769.269076:0:13026:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff994bc65d99c0) has exports, disconnecting them 00000020:00080000:0.0:1789545769.269081:0:13026:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff994bc9cea000), last request at 1789545550 00000020:00000080:0.0:1789545769.269093:0:13026:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c02f7 00000020:00010000:0.0:1789545769.269104:0:13026:0:(genops.c:1920:obd_stale_export_put()) Put export ffff994bc9cea000: total 2 00000100:00080000:0.0:1789545769.269109:0:13026:0:(import.c:65:import_set_state_nolock()) ffff994bc9ced800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789545769.269122:0:13026:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff994bc9cea000): rc 0 00000020:00080000:0.0:1789545769.269126:0:13026:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff994bc65d99c0) has no exports 00000020:00010000:0.0:1789545769.269135:0:8453:0:(genops.c:1906:obd_stale_export_get()) Get export ffff994bc9cea000: total 2 00010000:00010000:0.0:1789545769.269156:0:8453:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff994bc9cea000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1789545769.269418:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc8ba9400/0x64919c0f856c083e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x64919c0f856c0837 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545769.269436:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc49d0e00/0x64919c0f856c064d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x64919c0f856c0646 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545769.269446:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc8ba9e00/0x64919c0f856c084c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x64919c0f856c0845 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545769.269460:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bee11a400/0x64919c0f856c040f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x64919c0f856c0408 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545769.269473:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc8ba8600/0x64919c0f856c05f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x64919c0f856c05f2 expref: 5 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545769.269484:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc49d0600/0x64919c0f856c0607 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x64919c0f856c0600 expref: 4 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545769.269494:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc8ba8e00/0x64919c0f856c0615 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x64919c0f856c060e expref: 3 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545769.269504:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc0030000/0x64919c0f856c0623 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x64919c0f856c061c expref: 2 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789545769.269617:0:12196:0:(genops.c:844:class_export_destroy()) destroying export ffff994be54f5000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789545769.269623:0:12196:0:(genops.c:885:class_export_put()) final put ffff994bc8ffe000/lustre-MDD0000_UUID 00000020:00000080:1.0:1789545769.269625:0:12196:0:(genops.c:844:class_export_destroy()) destroying export ffff994bc8ffe000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789545769.269629:0:12196:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1789545769.269804:0:12196:0:(genops.c:844:class_export_destroy()) destroying export ffff994be54f6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1789545769.269837:0:8453:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff994bc9cea000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1789545769.269857:0:8453:0:(genops.c:885:class_export_put()) final put ffff994bc9cea000/beb86ab1-4563-44b1-afd1-f08a43b0622e 00010000:00010000:0.0:1789545769.269872:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545769.269874:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545769.269877:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545769.269939:0:5840:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff994beccce600:5840] 2 exiting: rc = 0 00000100:00100000:0.0:1789545769.270021:0:5839:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff994bede37800:5839] 1 exiting: rc = 0 00000020:00000080:1.0:1789545769.270088:0:12196:0:(genops.c:844:class_export_destroy()) destroying export ffff994bc9cea000/beb86ab1-4563-44b1-afd1-f08a43b0622e for MGS 00000020:00000080:1.0:1789545769.270109:0:12196:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff994bc9ced800 for MGS 00000100:00100000:3.0:1789545769.271236:0:5838:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff994bede36000:5838] 0 exiting: rc = 1 00000100:00100000:0.0:1789545769.271343:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.271350:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.271355:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.271384:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.271390:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.271395:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.271400:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.271407:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.271412:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.271418:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.271424:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.271429:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.271434:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.271439:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.271445:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.271451:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.271457:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.271462:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.271467:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.271471:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.271476:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.271481:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.271486:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.271491:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.271496:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.271500:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.271505:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.271511:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272099:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272104:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272109:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272114:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272120:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272125:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272131:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272137:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272142:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272147:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272153:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272159:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272170:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272447:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272453:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272458:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272463:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272469:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272479:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272485:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272490:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272495:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272500:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272506:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272511:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272588:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272604:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272676:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272684:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272690:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272700:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272706:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272712:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272717:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272722:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.272743:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1789545769.273140:0:13026:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789545769.273144:0:13026:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1789545769.275047:0:13026:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff994bc4a15e40 - data ffff994c00707af8/ffff994becdab400 00000020:01000000:0.0:1789545769.275170:0:13026:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff994bc4a1f960 - data ffff994c005c46c0/ffff994bd8cfb400 00000020:00000080:0.0:1789545769.277151:0:13026:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c02db 00000020:00000080:0.0:1789545769.277162:0:13026:0:(genops.c:885:class_export_put()) final put ffff994bc6482000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789545769.277271:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff994bc6482000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1789545769.277313:0:13026:0:(tgt_mount.c:187:server_put_mount()) put mount ffff994bc4a49800 from MGS, refs=2 00000020:01000004:0.0:1789545769.277317:0:13026:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994bc4a49800 2 00000020:01000004:0.0:1789545769.277320:0:13026:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff994bc4a49800 from MGS 00000020:00000080:0.0:1789545769.277340:0:13026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789545769.277347:0:13026:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1789545769.277350:0:13026:0:(genops.c:885:class_export_put()) final put ffff994bd8643000/MGS 00000020:00000080:0.0:1789545769.277352:0:13026:0:(genops.c:844:class_export_destroy()) destroying export ffff994bd8643000/MGS for MGS 00000020:01000000:0.0:1789545769.277432:0:13026:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1789545769.277628:0:13026:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1789545769.277632:0:13026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789545769.277638:0:13026:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789545769.277643:0:13026:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff994beccfc800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789545769.277649:0:13026:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff994bd8da4d40) has exports, disconnecting them 00000020:00080000:0.0:1789545769.277654:0:13026:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff994beccfc800), last request at 1789545551 00000020:00000080:0.0:1789545769.277658:0:13026:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c03a6 00000020:00080000:0.0:1789545769.277667:0:13026:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff994beccfc800): rc 0 00000020:00000080:0.0:1789545769.277671:0:13026:0:(genops.c:885:class_export_put()) final put ffff994beccfc800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789545769.278027:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff994beccfc800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789545769.296169:0:13026:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789545769.296243:0:13026:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789545769.296248:0:13026:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789545769.296257:0:13026:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789545769.296509:0:13026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789545769.296700:0:13026:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1789545769.296838:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff994beccfd800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789545769.296848:0:36:0:(genops.c:885:class_export_put()) final put ffff994bffa41800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789545769.296851:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff994bffa41800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1789545769.296860:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1789545769.297143:0:13026:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994bc4a49800 1 00000020:00000080:1.0:1789545769.297152:0:13026:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c02cd 00000020:00000080:1.0:1789545769.297161:0:13026:0:(genops.c:885:class_export_put()) final put ffff994bd8645000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1789545769.297785:0:13026:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1789545769.297794:0:13026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789545769.297800:0:13026:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789545769.297804:0:13026:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff994beddc0000) has no exports 00000020:00000080:2.0:1789545769.300211:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff994bd8645000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789545769.351394:0:13026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789545769.351419:0:13026:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789545769.351424:0:13026:0:(genops.c:885:class_export_put()) final put ffff994becdea800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789545769.351429:0:13026:0:(genops.c:844:class_export_destroy()) destroying export ffff994becdea800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789545769.351438:0:13026:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789545769.351649:0:13026:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff994bc4a4f000 00000020:01000000:0.0:1789545769.351673:0:13026:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789545769.351678:0:13026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789545769.351683:0:13026:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789545769.351687:0:13026:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff994bd08399c0) has no exports 00000100:00100000:0.0:1789545769.351766:0:5847:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff994bf5505c00:5847] 1 exiting: rc = 0 00000100:00100000:0.0:1789545769.351866:0:5846:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff994bc8bec000:5846] 0 exiting: rc = 1 00000100:00100000:2.0:1789545769.353165:0:10125:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff994be40e5a00:10125] 3 exiting: rc = 0 00000100:00100000:3.0:1789545769.357134:0:5848:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff994bd8cb5a00:5848] 2 exiting: rc = 0 00000100:00100000:0.0:1789545769.357285:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.357294:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.357299:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.357304:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.357309:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.357315:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.357321:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.357326:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.357331:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.357336:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.357341:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.357345:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.357350:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.357355:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358271:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358280:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358285:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358290:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358296:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358301:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358307:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358325:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358334:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358352:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358385:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358393:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358399:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358404:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358409:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358414:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358419:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358425:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358431:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358436:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358442:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358447:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358453:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358460:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358467:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358473:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358479:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358484:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358490:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358496:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358502:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358509:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358587:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358604:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358609:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358616:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358621:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358627:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358633:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358639:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358647:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358652:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358658:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358663:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358676:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358682:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358688:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358693:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358699:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545769.358711:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789545769.366952:0:5849:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff994bd8cb5e00:5849] 0 exiting: rc = 1 00000100:00100000:1.0:1789545769.367677:0:5850:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff994bc6625000:5850] 1 exiting: rc = 0 00000100:00100000:2.0:1789545769.367862:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.367871:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.367879:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.367886:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.367893:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.367898:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.367904:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.367910:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.367915:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.367921:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.367928:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.367933:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.367940:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.367946:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.367952:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.367957:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.367962:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.367967:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.367972:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.367977:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.367982:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.367986:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.367991:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.367995:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368000:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368023:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368028:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368032:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368037:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368042:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368047:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368052:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368057:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368062:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368068:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368072:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368077:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368082:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368088:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368093:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368098:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368103:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368108:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368113:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368118:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368123:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368129:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368135:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368140:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368145:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368151:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368157:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368162:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368167:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368171:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368248:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368253:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368258:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368263:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368268:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368280:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368284:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368290:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.368295:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789545769.369111:0:5851:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff994bd92ada00:5851] 0 exiting: rc = 1 00000100:00100000:0.0:1789545769.369274:0:5852:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff994bd92aca00:5852] 1 exiting: rc = 0 00000100:00100000:2.0:1789545769.369684:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369693:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369707:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369714:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369720:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369726:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369733:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369739:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369745:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369751:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369757:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369763:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369769:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369775:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369793:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369799:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369804:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369810:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369818:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369825:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369831:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369836:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369842:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369848:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369854:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369862:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369883:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369891:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369914:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369942:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369950:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369965:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369971:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369977:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369982:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369987:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369993:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.369998:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.370015:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.370021:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.370027:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.370033:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.370038:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.370044:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.370049:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.370055:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.370060:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.370065:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.370070:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.370076:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.370091:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.370096:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.370102:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.370107:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.370112:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.370117:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.370122:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.370128:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.370140:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.370152:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.370157:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.370164:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.370170:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.370253:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789545769.380934:0:5853:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff994bede2b400:5853] 0 exiting: rc = 1 00000100:00100000:2.0:1789545769.381080:0:5854:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff994bede2a600:5854] 1 exiting: rc = 0 00000100:00100000:2.0:1789545769.381143:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381161:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381167:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381244:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381252:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381258:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381263:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381269:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381275:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381280:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381286:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381291:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381296:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381301:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381306:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381311:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381316:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381321:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381325:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381331:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381336:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381341:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381345:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381350:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381355:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381423:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381429:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381434:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381439:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381452:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381457:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381462:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381467:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381472:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381478:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381483:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381496:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381501:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381505:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381619:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381628:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381633:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381638:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381643:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381647:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381652:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381657:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381661:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381666:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381672:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381677:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381682:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381687:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381691:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381696:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381700:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381705:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381709:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381714:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381719:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381723:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381727:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381731:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.381735:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382046:0:5856:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff994bc82b1000:5856] 1 exiting: rc = 0 00000100:00100000:2.0:1789545769.382108:0:5855:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff994bc6624c00:5855] 0 exiting: rc = 1 00000100:00100000:2.0:1789545769.382154:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382160:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382166:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382246:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382255:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382270:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382275:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382280:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382285:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382290:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382295:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382300:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382306:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382310:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382316:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382321:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382326:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382332:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382337:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382343:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382348:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382352:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382426:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382434:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382439:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382444:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382448:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382454:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382458:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382464:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382792:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382801:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382806:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382811:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382816:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382821:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382828:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382832:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382838:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382842:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382855:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382861:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382866:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382872:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382877:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382883:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382888:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382893:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382897:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382902:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382906:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382911:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382916:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382921:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382926:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382931:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382937:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382941:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382946:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382950:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382955:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382960:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382970:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.382975:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.383451:0:5858:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff994bc82b1200:5858] 1 exiting: rc = 0 00000100:00100000:1.0:1789545769.383671:0:5857:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff994bc82b0a00:5857] 0 exiting: rc = 1 00000100:00100000:2.0:1789545769.384001:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384009:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384015:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384020:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384026:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384031:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384036:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384042:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384047:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384052:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384069:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384075:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384080:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384085:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384090:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384105:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384111:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384117:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384122:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384129:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384134:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384140:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384146:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384152:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384157:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384163:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384169:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384188:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384195:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384200:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384206:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384212:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384218:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384223:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384228:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384233:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384238:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384243:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384249:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384254:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384261:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384266:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384272:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384277:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384283:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384297:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384303:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384309:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384315:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384320:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384324:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384330:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384335:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384340:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384345:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384350:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384356:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384476:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384481:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384486:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384491:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384496:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384501:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.384507:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789545769.385323:0:5859:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff994bc82b1600:5859] 0 exiting: rc = 1 00000100:00100000:2.0:1789545769.385789:0:5860:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff994bc82b0400:5860] 1 exiting: rc = 0 00000100:00100000:2.0:1789545769.385932:0:5861:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff994bede2b600:5861] 2 exiting: rc = 0 00000100:00100000:2.0:1789545769.388472:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388483:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388489:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388494:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388500:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388505:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388586:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388607:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388612:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388618:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388624:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388630:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388636:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388642:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388668:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388673:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388679:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388698:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388704:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388709:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388715:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388720:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388725:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388731:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388737:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388742:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388748:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388754:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388760:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388766:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388771:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388776:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388782:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388788:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388793:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388798:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388803:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388809:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388815:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388821:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388827:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388847:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388854:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388860:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388866:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388871:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388877:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388883:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388888:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388901:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388906:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388912:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388917:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388922:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388928:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388934:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388940:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388945:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388951:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388957:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388962:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388968:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388973:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545769.388979:0:13026:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789545769.398030:0:13026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789545769.398045:0:13026:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1789545769.398052:0:13026:0:(genops.c:885:class_export_put()) final put ffff994bc9dfc800/MDS_uuid 00000020:00000080:2.0:1789545769.398057:0:13026:0:(genops.c:844:class_export_destroy()) destroying export ffff994bc9dfc800/MDS_uuid for MDS 00000020:01000000:2.0:1789545769.398062:0:13026:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1789545769.398221:0:13026:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:3.0:1789545769.532694:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454953344:0@lo:400:kworker.0 00000400:00000100:3.0:1789545769.532747:0:3312:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876474454953344 offset 0 length 224: 4 00000100:00100000:3.0:1789545769.532814:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454953472:0@lo:400:kworker.0 00000400:00000100:3.0:1789545769.532836:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876474454953472 offset 0 length 224: 4 00000100:00100000:3.0:1789545769.532851:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789545769.532857:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876474454953600:0@lo:400:kworker.0 00000400:00000100:3.0:1789545769.532871:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876474454953600 offset 0 length 224: 4 00000001:00100000:2.0:1789545769.569743:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8a8edb7a-f384-4468-93f4-9d664f284862 00000020:00000080:2.0:1789545769.569754:0:7650:0:(genops.c:885:class_export_put()) final put ffff994bc2bc4800/8a8edb7a-f384-4468-93f4-9d664f284862 00000001:00100000:2.0:1789545769.569984:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789545769.569987:0:7650:0:(genops.c:885:class_export_put()) final put ffff994be4c98000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789545769.574056:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff994bc2bc4800/8a8edb7a-f384-4468-93f4-9d664f284862 for lustre-OST0001 00000020:00000080:2.0:1789545769.574120:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff994be4c98000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789545769.574141:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff994bc2bc1800 for lustre-OST0001 00000020:00000080:2.0:1789545769.574145:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff994be4c9a800 for lustre-OST0001 00010000:00010000:0.0:1789545769.790022:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545770.813003:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545771.836813:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789545772.200040:0:13177:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789545772.211526:0:13177:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1789545772.211585:0:13177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0030e00/0x64919c0f856c060e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0615 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545772.211601:0:13177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0030e00/0x64919c0f856c060e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c0615 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545772.211609:0:13177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0030e00/0x64919c0f856c060e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x64919c0f856c0615 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545772.211617:0:13177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.116@tcp lock: ffff994bc0030e00/0x64919c0f856c060e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x64919c0f856c0615 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545772.211639:0:13177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789545772.211646:0:13177:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789545772.211669:0:13177:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789545772.211680:0:13177:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff994be4b3df80 x1876474454953472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545785 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545772.211696:0:13177:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00100000:0.0:1789545772.211736:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454953472:0@lo:400:kworker.0 00000100:00080000:0.0:1789545772.211775:0:13177:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789545772.211797:0:13177:0:(import.c:65:import_set_state_nolock()) ffff994bfbcff800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1789545772.211939:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789545772.211947:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bc0030e00/0x64919c0f856c060e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x64919c0f856c0615 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545772.211965:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc0030e00 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:2.0:1789545772.211969:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bc0030e00/0x64919c0f856c060e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x64919c0f856c0615 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545772.211978:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bc0030e00/0x64919c0f856c060e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x64919c0f856c0615 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789545772.211985:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bc0030e00/0x64919c0f856c060e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x64919c0f856c0615 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789545772.211990:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789545772.211993:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789545772.211995:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789545772.212020:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bc0030e00/0x64919c0f856c060e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x64919c0f856c0615 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545772.212026:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789545772.212044:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bc0030e00/0x64919c0f856c060e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x64919c0f856c0615 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545772.212051:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bc0030e00/0x64919c0f856c060e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x64919c0f856c0615 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545772.212062:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545772.212064:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545772.212066:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545772.212080:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454953856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789545772.212142:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545772.212231:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454953856 00000100:00100000:2.0:1789545772.212244:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454953856 00000100:00100000:2.0:1789545772.212279:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789545772.212286:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3311:x1876474454953856:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789545772.212292:0:5832:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789545772 with bad export cookie 7246744865892729591 00000100:00100000:3.0:1789545772.217411:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1876474454953728:0@lo:39:umount.0 00000400:00000100:3.0:1789545772.217479:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876474454953728 offset 0 length 224: 4 00000100:00100000:2.0:1789545772.225651:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3311:x1876474454953856:12345-0@lo:103:ldlm_bl.0 Request processed in 13355us (13500us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789545772.225666:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1789545772.225739:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.116@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789545772.225744:0:3311:0:(import.c:65:import_set_state_nolock()) ffff994bc6485000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1789545772.225748:0:3311:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1789545772.232575:0:3311:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.116@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1789545772.232581:0:3311:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789545772.232590:0:3311:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff994be4b3d500 x1876474454953344/t0(0) o400->MGC192.168.201.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789545785 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545772.232666:0:3311:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff994be4edce00 x1876474454953856/t0(0) o103->MGC192.168.201.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789545788 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789545772.232677:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789545772.232679:0:3311:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789545772.232681:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789545772.232700:0:3311:0:(import.c:65:import_set_state_nolock()) ffff994bc6485000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789545772.232706:0:3311:0:(import.c:545:import_select_connection()) MGC192.168.201.116@tcp: connect to NID 0@lo last attempt 164 00000100:00080000:3.0:1789545772.232721:0:3311:0:(import.c:666:import_select_connection()) MGC192.168.201.116@tcp: import ffff994bc6485000 using connection 192.168.201.116@tcp/0@lo 00000100:00100000:3.0:1789545772.232752:0:3311:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994be4b3f480 x1876474454953984/t0(0) o250->MGC192.168.201.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789545772.232800:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beb86ab1-4563-44b1-afd1-f08a43b0622e:3311:1876474454953856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789545772.232917:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:beb86ab1-4563-44b1-afd1-f08a43b0622e:3310:1876474454953984:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1789545772.232964:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876474454953984 offset 0 length 520: 4 00000100:00100000:2.0:1789545772.233043:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beb86ab1-4563-44b1-afd1-f08a43b0622e:3312:1876474454953344:0@lo:400:kworker.0 00010000:00010000:0.0:1789545772.863460:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789545773.712115:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789545773.712125:0:6717:0:(genops.c:885:class_export_put()) final put ffff994bdf6cc800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789545773.712207:0:12196:0:(genops.c:844:class_export_destroy()) destroying export ffff994bdf6cc800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789545773.712270:0:12196:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff994bdf6ce800 for lustre-OST0000 00010000:00010000:0.0:1789545773.889078:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789545774.653270:0:1469:0:(pinger.c:229:ptlrpc_pinger_process_import()) beb86ab1-4563-44b1-afd1-f08a43b0622e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789545774.653280:0:1469:0:(pinger.c:247:ptlrpc_pinger_process_import()) beb86ab1-4563-44b1-afd1-f08a43b0622e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789545774.653615:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454954112:0@lo:400:kworker.0 00000400:00000100:3.0:1789545774.653675:0:3312:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876474454954112 offset 0 length 224: 4 00010000:00010000:2.0:1789545774.913946:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545775.933155:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545776.956965:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789545777.660538:0:1469:0:(pinger.c:229:ptlrpc_pinger_process_import()) beb86ab1-4563-44b1-afd1-f08a43b0622e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789545777.660549:0:1469:0:(pinger.c:247:ptlrpc_pinger_process_import()) beb86ab1-4563-44b1-afd1-f08a43b0622e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789545777.660690:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876474454954240:0@lo:400:kworker.0 00000400:00000100:0.0:1789545777.660766:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876474454954240 offset 0 length 224: 4 00010000:00010000:2.0:1789545777.980601:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545779.004609:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545780.035448:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545781.052599:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545782.076665:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545782.844846:0:3310:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789545772/real 1789545772] req@ffff994be4b3f480 x1876474454953984/t0(0) o250->MGC192.168.201.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789545782 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545782.844879:0:3310:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff994be4b3f480 x1876474454953984/t0(0) o250->MGC192.168.201.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789545782 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545782.844890:0:3310:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789545772/real 1789545772] req@ffff994be4799180 x1876474454953728/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789545782 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545782.844910:0:3310:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff994be4799180 x1876474454953728/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789545782 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789545782.844945:0:3310:0:(import.c:65:import_set_state_nolock()) ffff994bc6485000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789545782.845777:0:3310:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789545782.845784:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:beb86ab1-4563-44b1-afd1-f08a43b0622e:3310:1876474454953984:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1789545782.845792:0:3310:0:(import.c:65:import_set_state_nolock()) ffff994bfbcff800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789545782.845818:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1876474454953728:0@lo:39:umount.0 00000100:00080000:2.0:1789545782.845939:0:13177:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789545782.845944:0:13177:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789545782.845949:0:13177:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789545782.847281:0:13177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d1400/0x64919c0f856c061c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0623 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545782.847297:0:13177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d1400/0x64919c0f856c061c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c0623 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545782.847305:0:13177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d1400/0x64919c0f856c061c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x64919c0f856c0623 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545782.847311:0:13177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.116@tcp lock: ffff994bc49d1400/0x64919c0f856c061c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x64919c0f856c0623 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545782.847327:0:13177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789545782.847487:0:13177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994c0217ee00/0x64919c0f856c0845 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c084c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545782.847511:0:13177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994c0217ee00/0x64919c0f856c0845 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c084c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545782.847517:0:13177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994c0217ee00/0x64919c0f856c0845 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x64919c0f856c084c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545782.847523:0:13177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.116@tcp lock: ffff994c0217ee00/0x64919c0f856c0845 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x64919c0f856c084c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545782.847537:0:13177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789545782.847747:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789545782.847756:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bc49d1400/0x64919c0f856c061c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x64919c0f856c0623 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545782.847763:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1400 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:1.0:1789545782.847767:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bc49d1400/0x64919c0f856c061c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x64919c0f856c0623 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545782.847778:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bc49d1400/0x64919c0f856c061c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x64919c0f856c0623 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789545782.847786:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bc49d1400/0x64919c0f856c061c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x64919c0f856c0623 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789545782.847792:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789545782.847794:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1789545782.847806:0:5834:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff994bc6485000 00010000:00010000:1.0:1789545782.847810:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bc49d1400/0x64919c0f856c061c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x64919c0f856c0623 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545782.847817:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bc49d1400/0x64919c0f856c061c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x64919c0f856c0623 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545782.847834:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789545782.847837:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994c0217ee00/0x64919c0f856c0845 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x64919c0f856c084c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545782.847842:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994c0217ee00 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:1.0:1789545782.847852:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994c0217ee00/0x64919c0f856c0845 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x64919c0f856c084c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545782.847859:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994c0217ee00/0x64919c0f856c0845 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x64919c0f856c084c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789545782.847866:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994c0217ee00/0x64919c0f856c0845 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x64919c0f856c084c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789545782.847871:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789545782.847873:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789545782.847876:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789545782.847901:0:5834:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff994bc6485000 00010000:00010000:1.0:1789545782.847904:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994c0217ee00/0x64919c0f856c0845 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x64919c0f856c084c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545782.847910:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994c0217ee00/0x64919c0f856c0845 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x64919c0f856c084c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545782.847920:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545782.847922:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545782.847924:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789545782.847966:0:13177:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1789545782.847970:0:13177:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1789545782.847994:0:13177:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1789545782.847997:0:13177:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1789545782.848003:0:13177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789545782.848009:0:13177:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789545782.848013:0:13177:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff994be75ab380) has no exports 00000020:00080000:2.0:1789545782.848065:0:13177:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff994be75ab380) has no exports 00000100:00080000:3.0:1789545782.848407:0:12196:0:(pinger.c:229:ptlrpc_pinger_process_import()) beb86ab1-4563-44b1-afd1-f08a43b0622e->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789545782.848413:0:12196:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789545782.848417:0:12196:0:(import.c:65:import_set_state_nolock()) ffff994bc6485000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789545782.848425:0:12196:0:(import.c:545:import_select_connection()) MGC192.168.201.116@tcp: connect to NID 0@lo last attempt 386 00000100:00080000:3.0:1789545782.848430:0:12196:0:(import.c:630:import_select_connection()) MGC192.168.201.116@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789545782.848441:0:12196:0:(import.c:666:import_select_connection()) MGC192.168.201.116@tcp: import ffff994bc6485000 using connection 192.168.201.116@tcp/0@lo 00000100:00100000:3.0:1789545782.848476:0:12196:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994be4b3d180 x1876474454954368/t0(0) o250->MGC192.168.201.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789545782.848751:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:beb86ab1-4563-44b1-afd1-f08a43b0622e:3310:1876474454954368:0@lo:250:kworker.0 00000400:00000100:1.0:1789545782.848805:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876474454954368 offset 0 length 520: 4 00000100:00100000:3.0:1789545782.848814:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876474454954496:0@lo:400:kworker.0 00000400:00000100:3.0:1789545782.848847:0:3314:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876474454954496 offset 0 length 224: 4 00010000:00010000:0.0:1789545782.850504:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789545782.859527:0:13177:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff994ac27def00 - data ffff994bdffe6798/ffff994ac2113800 00000020:01000000:2.0:1789545782.859687:0:13177:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff994bc4b7eba0 - data ffff994bd89ee288/ffff994bdf990400 00100000:10000000:2.0:1789545782.873389:0:13177:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789545782.901275:0:13177:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c042b 00000020:00000080:0.0:1789545782.901286:0:13177:0:(genops.c:885:class_export_put()) final put ffff994bc6523000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1789545782.901339:0:13177:0:(tgt_mount.c:187:server_put_mount()) put mount ffff994bc8231800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1789545782.901354:0:13177:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994bc8231800 2 00000020:01000004:0.0:1789545782.901381:0:13177:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff994bc8231800 from lustre-OST0000 00000020:00000080:0.0:1789545782.901410:0:13177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789545782.901420:0:13177:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1789545782.901424:0:13177:0:(genops.c:885:class_export_put()) final put ffff994bfe8de000/lustre-OST0000_UUID 00000020:00000080:0.0:1789545782.901427:0:13177:0:(genops.c:844:class_export_destroy()) destroying export ffff994bfe8de000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1789545782.901434:0:13177:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1789545782.901484:0:13177:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1789545782.901489:0:13177:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789545782.901493:0:13177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789545782.901498:0:13177:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789545782.901505:0:13177:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff994bfbcf8800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789545782.901511:0:13177:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff994be75a8000) has exports, disconnecting them 00000020:00080000:0.0:1789545782.901527:0:13177:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff994bfbcf8800), last request at 1789545568 00000020:00000080:0.0:1789545782.901531:0:13177:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c0455 00000020:00080000:0.0:1789545782.901540:0:13177:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff994bfbcf8800): rc 0 00000020:00000080:0.0:1789545782.901681:0:13177:0:(genops.c:885:class_export_put()) final put ffff994bfbcf8800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789545782.901952:0:12196:0:(genops.c:844:class_export_destroy()) destroying export ffff994bc6523000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789545782.902675:0:12196:0:(genops.c:844:class_export_destroy()) destroying export ffff994bfbcf8800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789545782.914450:0:13177:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789545782.914459:0:13177:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789545782.914464:0:13177:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789545782.914471:0:13177:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789545782.914630:0:12196:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff994bfbcff800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789545782.914840:0:13177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789545782.914849:0:13177:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1789545782.914855:0:13177:0:(genops.c:885:class_export_put()) final put ffff994bfbcfc800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1789545782.914859:0:13177:0:(genops.c:844:class_export_destroy()) destroying export ffff994bfbcfc800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1789545782.914885:0:13177:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1789545782.914945:0:13177:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994bc8231800 1 00000020:00000080:2.0:1789545782.914951:0:13177:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c03e5 00000020:00000080:2.0:1789545782.914957:0:13177:0:(genops.c:885:class_export_put()) final put ffff994beccf8000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1789545782.914971:0:13177:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1789545782.914975:0:13177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789545782.914980:0:13177:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789545782.914984:0:13177:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff994bd8da3380) has no exports 00000020:00000080:3.0:1789545782.915144:0:12196:0:(genops.c:844:class_export_destroy()) destroying export ffff994beccf8000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789545782.936689:0:13177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789545782.936720:0:13177:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1789545782.936726:0:13177:0:(genops.c:885:class_export_put()) final put ffff994bc8235000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1789545782.936731:0:13177:0:(genops.c:844:class_export_destroy()) destroying export ffff994bc8235000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1789545782.936738:0:13177:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1789545782.936888:0:13177:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff994bc8232800 00000020:02000400:3.0:1789545782.936946:0:13177:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1789545783.255637:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545784.317636:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545785.340618:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1789545785.793188:0:3313:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789545769/real 1789545769] req@ffff994be4b3dc00 x1876474454953600/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789545785 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545785.821451:0:3313:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff994be4b3dc00 x1876474454953600/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789545785 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789545785.821466:0:3313:0:(import.c:65:import_set_state_nolock()) ffff994be5050000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789545785.821471:0:3313:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789545785.835215:0:3313:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00080000:3.0:1789545785.835327:0:1469:0:(pinger.c:229:ptlrpc_pinger_process_import()) beb86ab1-4563-44b1-afd1-f08a43b0622e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789545785.835334:0:1469:0:(pinger.c:247:ptlrpc_pinger_process_import()) beb86ab1-4563-44b1-afd1-f08a43b0622e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789545785.835337:0:1469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1789545785.835338:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876474454953600:0@lo:400:kworker.0 00000100:00080000:3.0:1789545785.835340:0:1469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789545785.835344:0:1469:0:(import.c:65:import_set_state_nolock()) ffff994be5050000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789545785.835354:0:1469:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 198 00000100:00080000:3.0:1789545785.835388:0:1469:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff994be5050000 using connection 192.168.201.116@tcp/0@lo 00000100:00100000:3.0:1789545785.837583:0:1469:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994be4b3c000 x1876474454954624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:01000004:1.0:1789545785.837979:0:13331:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000100:00100000:0.0:1789545785.838725:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1876474454954624:0@lo:38:kworker.0 00000400:00000100:0.0:1789545785.838779:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876474454954624 offset 0 length 520: 4 00000020:01000004:1.0:1789545785.853158:0:13331:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1789545785.853232:0:13331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0030a00/0x64919c0f856c05f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c05f9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545785.853246:0:13331:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0030a00/0x64919c0f856c05f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c05f9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545785.853262:0:13331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc0030a00/0x64919c0f856c05f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x64919c0f856c05f9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545785.853269:0:13331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.116@tcp lock: ffff994bc0030a00/0x64919c0f856c05f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x64919c0f856c05f9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545785.853347:0:13331:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789545785.853353:0:13331:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789545785.853402:0:13331:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789545785.853414:0:13331:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff994be4799c00 x1876474454954112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545790 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545785.853430:0:13331:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff994be4f42a00 x1876474454954240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545793 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545785.853446:0:13331:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff994be4b3ea00 x1876474454954496/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545798 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545785.853458:0:13331:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff994be4b3c000 x1876474454954624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789545795 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545785.853471:0:13331:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789545785.853476:0:13331:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789545785.853482:0:13331:0:(import.c:65:import_set_state_nolock()) ffff994be5050000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789545785.853487:0:13331:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789545785.853491:0:13331:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff994be4799c00 x1876474454954112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545790 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545785.853498:0:13331:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff994be4f42a00 x1876474454954240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545793 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545785.853506:0:13331:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff994be4b3ea00 x1876474454954496/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545798 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545785.853520:0:13331:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff994be4b3c000 x1876474454954624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789545795 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789545785.853526:0:13331:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789545785.853530:0:13331:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:3.0:1789545785.853611:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454954112:0@lo:400:kworker.0 00000100:00100000:3.0:1789545785.853656:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876474454954496:0@lo:400:kworker.0 00000100:00100000:2.0:1789545785.853758:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876474454954240:0@lo:400:kworker.0 00010000:00010000:0.0:1789545785.853848:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789545785.853857:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bc0030a00/0x64919c0f856c05f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x64919c0f856c05f9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545785.853865:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc0030a00 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:0.0:1789545785.853869:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bc0030a00/0x64919c0f856c05f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x64919c0f856c05f9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545785.853878:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bc0030a00/0x64919c0f856c05f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x64919c0f856c05f9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789545785.853885:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bc0030a00/0x64919c0f856c05f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x64919c0f856c05f9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789545785.853891:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789545785.853894:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789545785.853902:0:5835:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789545785.853915:0:5835:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff994bc6485000 00010000:00010000:0.0:1789545785.853919:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bc0030a00/0x64919c0f856c05f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x64919c0f856c05f9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545785.853926:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bc0030a00/0x64919c0f856c05f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x64919c0f856c05f9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545785.853939:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545785.853940:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545785.853942:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545785.853958:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1876474454954624:0@lo:38:kworker.0 00010000:00010000:1.0:1789545785.855777:0:13331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8c00/0x64919c0f856c0600 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c0607 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545785.855794:0:13331:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8c00/0x64919c0f856c0600 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c0607 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545785.855801:0:13331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8c00/0x64919c0f856c0600 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x64919c0f856c0607 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545785.855807:0:13331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8c00/0x64919c0f856c0600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x64919c0f856c0607 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545785.856424:0:13331:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789545785.856437:0:13331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c0837 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c083e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545785.856446:0:13331:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c0837 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c083e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545785.856452:0:13331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c0837 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x64919c0f856c083e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545785.856458:0:13331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c0837 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x64919c0f856c083e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545785.856681:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789545785.856689:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8c00/0x64919c0f856c0600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x64919c0f856c0607 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545785.856697:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba8c00 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:2.0:1789545785.856701:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8c00/0x64919c0f856c0600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x64919c0f856c0607 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545785.856710:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8c00/0x64919c0f856c0600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x64919c0f856c0607 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789545785.856718:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8c00/0x64919c0f856c0600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x64919c0f856c0607 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789545785.856723:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789545785.856725:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1789545785.856736:0:5834:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff994bc6485000 00010000:00010000:2.0:1789545785.856740:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8c00/0x64919c0f856c0600 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x64919c0f856c0607 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545785.856747:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8c00/0x64919c0f856c0600 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x64919c0f856c0607 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545785.857145:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789545785.857150:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c0837 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x64919c0f856c083e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545785.857156:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6c00 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:2.0:1789545785.857159:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c0837 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x64919c0f856c083e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545785.857166:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c0837 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x64919c0f856c083e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789545785.857173:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c0837 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x64919c0f856c083e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789545785.857178:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789545785.857180:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1789545785.857185:0:5834:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff994bc6485000 00010000:00010000:2.0:1789545785.857188:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c0837 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x64919c0f856c083e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545785.857195:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545785.857197:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545785.857199:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545785.857287:0:13331:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789545785.857302:0:13331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c0837 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x64919c0f856c083e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789545785.857316:0:13331:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1789545785.857321:0:13331:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1789545785.857323:0:13331:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1789545785.857353:0:13331:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1789545785.857615:0:13331:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1789545785.857623:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789545785.857629:0:13331:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789545785.857634:0:13331:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff994be40ab380) has no exports 00000020:00080000:1.0:1789545785.857660:0:13331:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff994be40ab380) has no exports 00010000:00010000:0.0:1789545785.858501:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789545785.860978:0:13331:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff994ac27de360 - data ffff994bdffe6e58/ffff994ac2111400 00000020:01000000:1.0:1789545785.861155:0:13331:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff994ac27de060 - data ffff994bdffa2948/ffff994becdb8800 00100000:10000000:1.0:1789545785.875244:0:13331:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789545785.896342:0:13331:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c04f6 00000020:00000080:0.0:1789545785.896355:0:13331:0:(genops.c:885:class_export_put()) final put ffff994bdfcb3800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789545785.896397:0:13331:0:(tgt_mount.c:187:server_put_mount()) put mount ffff994bdfb06800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789545785.896403:0:13331:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994bdfb06800 2 00000020:01000004:0.0:1789545785.896406:0:13331:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff994bdfb06800 from lustre-OST0001 00000020:00000080:0.0:1789545785.896435:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789545785.896445:0:13331:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789545785.896447:0:13331:0:(genops.c:885:class_export_put()) final put ffff994bdfcb1000/lustre-OST0001_UUID 00000020:00000080:0.0:1789545785.896450:0:13331:0:(genops.c:844:class_export_destroy()) destroying export ffff994bdfcb1000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789545785.896457:0:13331:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1789545785.896562:0:13331:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import beb86ab1-4563-44b1-afd1-f08a43b0622e->MGS 00010000:00010000:0.0:1789545785.896579:0:13331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bc49d0800/0x64919c0f856c0408 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x64919c0f856c040f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789545785.896592:0:13331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bc49d0800/0x64919c0f856c0408 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x64919c0f856c040f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789545785.896598:0:13331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789545785.896617:0:13331:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789545785.896620:0:13331:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789545785.896635:0:13331:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff994bc6485000 00010000:00010000:0.0:1789545785.896639:0:13331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bc49d0800/0x64919c0f856c0408 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x64919c0f856c040f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545785.896654:0:13331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c0646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x64919c0f856c064d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789545785.896660:0:13331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c0646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x64919c0f856c064d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789545785.896666:0:13331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789545785.896668:0:13331:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789545785.896669:0:13331:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789545785.896679:0:13331:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff994bc6485000 00010000:00010000:0.0:1789545785.896682:0:13331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bc0031e00/0x64919c0f856c0646 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x64919c0f856c064d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789545785.896839:0:1469:0:(genops.c:844:class_export_destroy()) destroying export ffff994bdfcb3800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:0.0:1789545785.896884:0:13331:0:(import.c:65:import_set_state_nolock()) ffff994bc6485000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789545785.896889:0:13331:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789545785.896892:0:13331:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789545785.896893:0:13331:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789545785.896897:0:13331:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789545785.896909:0:13331:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff994be4b3d180 x1876474454954368/t0(0) o250->MGC192.168.201.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789545797 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789545785.896922:0:13331:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789545785.896929:0:13331:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:2.0:1789545785.897000:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:beb86ab1-4563-44b1-afd1-f08a43b0622e:3310:1876474454954368:0@lo:250:kworker.0 10000000:01000000:3.0:1789545785.897051:0:13331:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789545785.897059:0:13331:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c02e9 00000020:00000080:3.0:1789545785.897064:0:13331:0:(genops.c:885:class_export_put()) final put ffff994bc9df9800/beb86ab1-4563-44b1-afd1-f08a43b0622e 00000020:01000000:3.0:1789545785.897073:0:13331:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.116@tcp (flags='') 00000020:00000080:3.0:1789545785.897081:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789545785.897087:0:13331:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.116@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789545785.897090:0:13331:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff994bc65dcd40) has no exports 10000000:01000000:3.0:1789545785.897106:0:5843:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1789545785.897153:0:13331:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.116@tcp: client import never connected 00000100:00080000:3.0:1789545785.897156:0:13331:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1789545785.897165:0:13331:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789545785.897167:0:13331:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1789545785.897169:0:13331:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789545785.897200:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789545785.897204:0:13331:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.116@tcp (uuid beb86ab1-4563-44b1-afd1-f08a43b0622e) 00000020:01000000:3.0:1789545785.897211:0:13331:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789545785.897215:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789545785.897218:0:13331:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789545785.897222:0:13331:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff994be5051800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789545785.897227:0:13331:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff994be40a8000) has exports, disconnecting them 00000020:00080000:3.0:1789545785.897231:0:13331:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff994be5051800), last request at 1789545584 00000020:00000080:3.0:1789545785.897234:0:13331:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c0520 00000020:00080000:3.0:1789545785.897245:0:13331:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff994be5051800): rc 0 00000020:00000080:3.0:1789545785.897248:0:13331:0:(genops.c:885:class_export_put()) final put ffff994be5051800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789545785.898016:0:1469:0:(genops.c:844:class_export_destroy()) destroying export ffff994bc9df9800/beb86ab1-4563-44b1-afd1-f08a43b0622e for MGC192.168.201.116@tcp 00000020:00000080:2.0:1789545785.898026:0:1469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff994bc6485000 for MGC192.168.201.116@tcp 00000020:00000080:2.0:1789545785.898031:0:1469:0:(genops.c:885:class_export_put()) final put ffff994bc6481000/beb86ab1-4563-44b1-afd1-f08a43b0622e 00000020:00000080:2.0:1789545785.898040:0:1469:0:(genops.c:844:class_export_destroy()) destroying export ffff994bc6481000/beb86ab1-4563-44b1-afd1-f08a43b0622e for MGC192.168.201.116@tcp 00000020:01000000:2.0:1789545785.898043:0:1469:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.116@tcp (beb86ab1-4563-44b1-afd1-f08a43b0622e) 00000020:00000080:2.0:1789545785.898619:0:1469:0:(genops.c:844:class_export_destroy()) destroying export ffff994be5051800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1789545785.899447:0:13331:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789545785.899452:0:13331:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789545785.899456:0:13331:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789545785.899461:0:13331:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789545785.899546:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1789545785.899626:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:0.0:1789545785.899813:0:1469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff994be5050000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1789545785.900267:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1789545785.900909:0:7635:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff994bffcc9600:7635] 2 exiting: rc = 0 00000100:00100000:0.0:1789545785.901043:0:5830:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff994bd8f87600:5830] 1 exiting: rc = 0 00000100:00100000:2.0:1789545785.901601:0:5829:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff994bd8f87e00:5829] 0 exiting: rc = 1 00000100:00100000:0.0:1789545785.901778:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.902063:0:5831:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff994bd8f86e00:5831] 0 exiting: rc = 1 00000100:00100000:2.0:1789545785.902225:0:7637:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_004: service thread [ffff994bc4b60000:7637] 4 exiting: rc = 0 00000100:00100000:2.0:1789545785.902720:0:7636:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff994bc4b61200:7636] 3 exiting: rc = 0 00000100:00100000:2.0:1789545785.903175:0:5832:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff994bc5422600:5832] 1 exiting: rc = 0 00000100:00100000:2.0:1789545785.903229:0:5833:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff994beccbba00:5833] 2 exiting: rc = 0 00000100:00100000:0.0:1789545785.903520:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903529:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903535:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903541:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903547:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903552:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903558:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903565:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903571:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903576:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903581:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903587:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903592:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903597:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903602:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903607:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903623:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903629:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903635:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903640:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903645:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903649:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903655:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903661:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903666:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903672:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903678:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903683:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903688:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903697:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903702:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903710:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903715:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903733:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903738:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903743:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903747:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903751:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903756:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903760:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903765:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903772:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903777:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903782:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903786:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903790:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903795:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903799:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903804:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903809:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903813:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903818:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903822:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903827:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903831:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903835:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903839:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903843:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903847:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903851:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903855:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903859:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903863:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.903868:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789545785.905468:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789545785.905480:0:13331:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1789545785.905486:0:13331:0:(genops.c:885:class_export_put()) final put ffff994bdfcb2000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1789545785.905490:0:13331:0:(genops.c:844:class_export_destroy()) destroying export ffff994bdfcb2000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1789545785.905508:0:13331:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1789545785.905550:0:13331:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994bdfb06800 1 00000020:00000080:0.0:1789545785.905557:0:13331:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x64919c0f856c04c5 00000020:00000080:0.0:1789545785.905564:0:13331:0:(genops.c:885:class_export_put()) final put ffff994bc9df8000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1789545785.905577:0:13331:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1789545785.905582:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789545785.905587:0:13331:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789545785.905591:0:13331:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff994beddc19c0) has no exports 00000020:00000080:2.0:1789545785.905839:0:1469:0:(genops.c:844:class_export_destroy()) destroying export ffff994bc9df8000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789545785.928162:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789545785.928180:0:13331:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789545785.928185:0:13331:0:(genops.c:885:class_export_put()) final put ffff994bdfb02800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789545785.928190:0:13331:0:(genops.c:844:class_export_destroy()) destroying export ffff994bdfb02800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789545785.928197:0:13331:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789545785.928419:0:13331:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff994bdfb04000 00000020:01000000:0.0:1789545785.928440:0:13331:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789545785.928445:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789545785.928449:0:13331:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789545785.928453:0:13331:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff994be75acd40) has no exports 00000020:00000080:0.0:1789545785.928475:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789545785.928482:0:13331:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789545785.928485:0:13331:0:(genops.c:885:class_export_put()) final put ffff994beccfa800/OSS_uuid 00000020:00000080:0.0:1789545785.928487:0:13331:0:(genops.c:844:class_export_destroy()) destroying export ffff994beccfa800/OSS_uuid for OSS 00000020:01000000:0.0:1789545785.928491:0:13331:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1789545785.928569:0:12592:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff994bc64b7c00:12592] 4 exiting: rc = 0 00000100:00100000:1.0:1789545785.929321:0:6693:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff994bc9d53000:6693] 2 exiting: rc = 0 00000100:00100000:0.0:1789545785.931452:0:6691:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff994bc9d53800:6691] 0 exiting: rc = 1 00000100:00100000:0.0:1789545785.931543:0:6692:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff994bc9d53e00:6692] 1 exiting: rc = 0 00000100:00100000:0.0:1789545785.936491:0:8211:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff994be4c76e00:8211] 3 exiting: rc = 0 00000100:00080000:0.0:1789545785.936581:0:5842:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1789545785.936721:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.936731:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.936738:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.936745:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.936764:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.936770:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.936775:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.936780:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.936785:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.936791:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.936796:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.936802:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.936807:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.936811:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.936817:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.936823:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.936828:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.936833:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.936839:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.936844:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.936849:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.936855:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.936860:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.936866:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937135:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937146:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937150:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937155:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937160:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937165:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937171:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937176:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937181:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937185:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937190:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937195:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937201:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937206:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937211:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937225:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937230:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937235:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937240:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937246:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937251:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937256:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937262:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937268:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937273:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937279:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937284:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937299:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937306:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937312:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937321:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937326:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937331:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937338:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937342:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937346:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937351:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937355:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937391:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.937397:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.939840:0:6695:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff994bc9d53200:6695] 1 exiting: rc = 0 00000100:00100000:3.0:1789545785.945556:0:6694:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff994bc9d52a00:6694] 0 exiting: rc = 1 00000100:00100000:0.0:1789545785.946144:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946154:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946158:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946164:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946170:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946175:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946180:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946186:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946191:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946209:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946213:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946218:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946223:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946228:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946233:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946238:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946243:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946248:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946254:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946260:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946265:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946270:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946275:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946280:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946285:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946302:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946308:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946313:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946318:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946323:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946327:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946333:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946337:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946342:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946349:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946354:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946476:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946482:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946487:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946492:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946497:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946502:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946508:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946513:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946526:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946531:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946536:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946542:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946547:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946552:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946557:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946562:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946567:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946572:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946577:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946582:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946587:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946592:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946596:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946601:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.946606:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.948111:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.948118:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.948125:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789545785.949434:0:6697:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff994bc9d53600:6697] 1 exiting: rc = 0 00000100:00100000:0.0:1789545785.949434:0:6698:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff994bc9d52400:6698] 2 exiting: rc = 0 00000100:00100000:2.0:1789545785.949649:0:6696:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff994bfbfc1e00:6696] 0 exiting: rc = 1 00000100:00100000:0.0:1789545785.950672:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950692:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950700:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950707:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950712:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950718:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950724:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950729:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950735:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950740:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950746:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950751:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950756:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950762:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950791:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950797:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950802:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950808:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950825:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950832:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950838:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950844:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950849:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950855:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950860:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950866:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950871:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950876:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950882:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950887:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950892:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950897:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950902:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950907:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950913:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950919:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950925:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950929:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950935:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950940:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950945:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950951:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950970:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950983:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950989:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950994:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.950999:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.951004:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.951009:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.951022:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.951027:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.951034:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.951039:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.951045:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.951050:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.951061:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.951066:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.951072:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.951077:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.951081:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.951086:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.951104:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.951109:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.951115:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789545785.955563:0:6699:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff994bc9d53c00:6699] 0 exiting: rc = 1 00000100:00100000:0.0:1789545785.955670:0:6700:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff994bc9d52e00:6700] 1 exiting: rc = 0 00000100:00100000:0.0:1789545785.955866:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.955874:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.955879:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.955885:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.955889:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.955894:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.955899:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.955904:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.955908:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.955913:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.955918:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.955922:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.955926:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.955931:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.955937:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.955942:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.955946:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.955971:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.955977:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.955993:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.955998:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956003:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956009:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956014:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956019:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956024:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956028:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956033:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956037:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956042:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956047:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956051:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956056:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956062:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956067:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956078:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956083:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956088:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956092:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956096:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956101:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956106:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956112:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956116:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956121:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956126:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956130:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956135:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956140:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956145:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956151:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956156:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956162:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956167:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956180:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956185:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956190:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956195:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956201:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956206:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956212:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956217:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956222:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.956228:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957009:0:6701:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff994bfbfc0e00:6701] 0 exiting: rc = 1 00000100:00100000:2.0:1789545785.957185:0:6702:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff994bfbfc1c00:6702] 1 exiting: rc = 0 00000100:00100000:0.0:1789545785.957463:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957471:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957477:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957482:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957487:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957493:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957499:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957505:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957510:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957532:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957539:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957544:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957550:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957556:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957563:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957569:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957575:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957581:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957587:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957593:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957599:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957621:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957628:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957635:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957652:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957658:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957664:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957671:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957677:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957683:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957689:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957695:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957701:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957723:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957730:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957736:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957742:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957748:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957754:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957759:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957765:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957770:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957776:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957783:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957788:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957809:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957818:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957824:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957830:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957836:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957842:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957848:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957853:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957859:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957865:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957871:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957877:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957897:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957905:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957917:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957923:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957930:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957936:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789545785.957950:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789545785.965504:0:13331:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1789545803.365349:0:13945:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg116-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789545812.461345:0:14405:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789545812.461351:0:14405:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1789545812.461492:0:14405:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff994bdfb81000 00000020:01000004:0.0:1789545812.461508:0:14405:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1789545812.461517:0:14405:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789545812.461533:0:14405:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff994bd8da0000) 00000020:00000080:0.0:1789545812.461547:0:14405:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789545812.485273:0:14405:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789545812.489260:0:14405:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1789545812.489889:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1789545812.490030:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1789545812.490128:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1789545812.490326:0:14405:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789545812.490453:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:2.0:1789545812.490547:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:2.0:1789545812.490630:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:2.0:1789545812.490872:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:2.0:1789545812.493432:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 545: rc = 0 00100000:10000000:2.0:1789545812.493543:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 545: rc = 0 00100000:10000000:2.0:1789545812.496797:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 649: rc = 0 00100000:10000000:2.0:1789545812.498014:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 649: rc = 0 00100000:10000000:2.0:1789545812.498270:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 649: rc = 0 00100000:10000000:2.0:1789545812.498524:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 649: rc = 0 00100000:10000000:2.0:1789545812.498775:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 649: rc = 0 00100000:10000000:2.0:1789545812.499037:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 649: rc = 0 00100000:10000000:2.0:1789545812.499281:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 649: rc = 0 00100000:10000000:2.0:1789545812.499570:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 649: rc = 0 00100000:10000000:2.0:1789545812.499831:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 649: rc = 0 00100000:10000000:2.0:1789545812.500079:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 649: rc = 0 00100000:10000000:2.0:1789545812.500318:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 649: rc = 0 00100000:10000000:2.0:1789545812.500593:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 649: rc = 0 00100000:10000000:3.0:1789545812.503599:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 351: rc = 0 00100000:10000000:3.0:1789545812.503919:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 351: rc = 0 00100000:10000000:3.0:1789545812.504496:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 351: rc = 0 00100000:10000000:3.0:1789545812.504683:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 351: rc = 0 00100000:10000000:3.0:1789545812.504904:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 351: rc = 0 00100000:10000000:3.0:1789545812.505294:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 351: rc = 0 00100000:10000000:3.0:1789545812.511283:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 351: rc = 0 00100000:10000000:3.0:1789545812.511610:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 351: rc = 0 00100000:10000000:3.0:1789545812.513942:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 351: rc = 0 00100000:10000000:3.0:1789545812.514253:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 351: rc = 0 00100000:10000000:3.0:1789545812.514519:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 351: rc = 0 00100000:10000000:3.0:1789545812.514764:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 351: rc = 0 00100000:10000000:3.0:1789545812.515056:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 351: rc = 0 00100000:10000000:3.0:1789545812.515300:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 351: rc = 0 00100000:10000000:3.0:1789545812.515585:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 351: rc = 0 00100000:10000000:3.0:1789545812.515866:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 351: rc = 0 00100000:10000000:3.0:1789545812.516120:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 351: rc = 0 00100000:10000000:3.0:1789545812.516411:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 351: rc = 0 00100000:10000000:3.0:1789545812.516652:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 351: rc = 0 00100000:10000000:3.0:1789545812.518883:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 351: rc = 0 00100000:10000000:3.0:1789545812.519346:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 351: rc = 0 00100000:10000000:3.0:1789545812.519667:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 351: rc = 0 00100000:10000000:3.0:1789545812.519948:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 351: rc = 0 00100000:10000000:3.0:1789545812.520343:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 351: rc = 0 00100000:10000000:3.0:1789545812.524318:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 351: rc = 0 00100000:10000000:3.0:1789545812.524605:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 351: rc = 0 00100000:10000000:3.0:1789545812.524869:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 351: rc = 0 00100000:10000000:3.0:1789545812.525129:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 351: rc = 0 00100000:10000000:3.0:1789545812.525399:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 351: rc = 0 00100000:10000000:3.0:1789545812.525634:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 351: rc = 0 00100000:10000000:3.0:1789545812.529962:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 351: rc = 0 00100000:10000000:3.0:1789545812.530388:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 351: rc = 0 00100000:10000000:3.0:1789545812.530760:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 662: rc = 0 00100000:10000000:3.0:1789545812.535559:0:14405:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1789545812.535735:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 546: rc = 0 00100000:10000000:3.0:1789545812.535957:0:14405:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1789545812.536027:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 546: rc = 0 00100000:10000000:3.0:1789545812.536227:0:14405:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1789545812.536301:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 546: rc = 0 00100000:10000000:3.0:1789545812.536680:0:14405:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1789545812.536751:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 645: rc = 0 00100000:10000000:0.0:1789545812.538033:0:14405:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1789545812.538142:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 645: rc = 0 00100000:10000000:0.0:1789545812.538352:0:14405:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1789545812.538453:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 645: rc = 0 00000020:00000080:0.0:1789545812.538719:0:14405:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1789545812.538729:0:14405:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789545812.538739:0:14405:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x64919c0f856c15dc 00000020:01000004:0.0:1789545812.538747:0:14405:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1789545812.538751:0:14405:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1789545812.538757:0:14405:0:(tgt_mount.c:101:server_register_mount()) register mount ffff994bdfb81000 from MGS 00000020:01000004:0.0:1789545812.538760:0:14405:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1789545812.538769:0:14405:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff994bd8da19c0) 00000020:00000080:0.0:1789545812.538779:0:14405:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1789545812.538843:0:14405:0:(tgt_mount.c:153:server_get_mount()) get mount ffff994bdfb81000 from MGS, refs=2 00080000:01000000:0.0:1789545812.538848:0:14405:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789545812.538854:0:14405:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x64919c0f856c15ea 00000100:00100000:0.0:1789545812.538944:0:14405:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1789545812.539067:0:14405:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1789545812.539078:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789545812.539656:0:14405:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789545812.539664:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789545812.541855:0:14405:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789545812.542043:0:14405:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789545812.542049:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789545812.542838:0:14405:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789545812.542848:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789545812.543268:0:14405:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789545812.543275:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789545812.551858:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545812.551866:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545812.551869:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545812.559109:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545812.559116:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545812.559119:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545812.559723:0:14405:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789545812.562935:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789545812.578683:0:14405:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1789545812.578706:0:14405:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789545812.578709:0:14405:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789545812.590688:0:14415:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789545812.590955:0:14405:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789545812.591078:0:14405:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789545812.591648:0:14405:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789545812.591954:0:14405:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789545812.592120:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789545812.592126:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789545812.598873:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789545812.598889:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789545812.599313:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789545812.599320:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789545812.599953:0:14405:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789545812.599975:0:14405:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.116@tcp' 00000020:01000004:0.0:1789545812.599977:0:14405:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789545812.600010:0:14405:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.116@tcp (typ=mgc) 00000020:00000080:0.0:1789545812.600025:0:14405:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.116@tcp (ffff994bd8da3380) 00000020:00000080:0.0:1789545812.600043:0:14405:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789545812.600117:0:14405:0:(ldlm_lib.c:102:import_set_conn()) imp ffff994be43a4000@MGC192.168.201.116@tcp: add connection 192.168.201.116@tcp at head 00010000:00010000:0.0:1789545812.600279:0:14405:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.116@tcp-0 is initialized 00000040:01000000:0.0:1789545812.600284:0:14405:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.116@tcp ctxt 1 is initialized 00000100:00080000:1.0:1789545812.600551:0:14419:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789545812.613980:0:14420:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789545812.620596:0:14405:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.116@tcp (uuid 6de5819a-62ff-4f85-af03-c287b54b27c1) 00000020:00000080:0.0:1789545812.620630:0:14405:0:(genops.c:1384:class_connect()) connect: client 6de5819a-62ff-4f85-af03-c287b54b27c1, cookie 0x64919c0f856c15f8 00000100:00080000:0.0:1789545812.620643:0:14405:0:(import.c:545:import_select_connection()) MGC192.168.201.116@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789545812.620655:0:14405:0:(import.c:666:import_select_connection()) MGC192.168.201.116@tcp: import ffff994be43a4000 using connection 192.168.201.116@tcp/0@lo 00000100:00100000:0.0:1789545812.620692:0:14405:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994be4798380 x1876474454954752/t0(0) o250->MGC192.168.201.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789545812.620760:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6de5819a-62ff-4f85-af03-c287b54b27c1:3310:1876474454954752:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789545812.620848:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789545812.621575:0:14405:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6de5819a-62ff-4f85-af03-c287b54b27c1->MGS 00000020:01000004:0.0:1789545812.621595:0:14405:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789545812.621601:0:14405:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789545812.621615:0:14405:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff994bd8da4d40) 00000020:00000080:0.0:1789545812.621629:0:14405:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789545812.626564:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454954752 00000100:00100000:1.0:1789545812.626584:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454954752 00000100:00100000:1.0:1789545812.626650:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789545812.626658:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3310:x1876474454954752:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1789545812.626690:0:14417:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 6de5819a-62ff-4f85-af03-c287b54b27c1@0@lo t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:1.0:1789545812.626725:0:14417:0:(genops.c:1384:class_connect()) connect: client 6de5819a-62ff-4f85-af03-c287b54b27c1, cookie 0x64919c0f856c1606 00000100:00080000:1.0:1789545812.626898:0:14417:0:(import.c:65:import_set_state_nolock()) ffff994bc8232800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789545812.632684:0:14405:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789545812.638800:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+5:3310:x1876474454954752:12345-0@lo:250:mount.lustre.0 Request processed in 12130us (17940us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545812.638827:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789545812.640686:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789545812.640696:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789545812.641429:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789545812.641437:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789545812.641802:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789545812.641820:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789545812.642445:0:14405:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789545812.642597:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789545812.642603:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789545812.643422:0:3310:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.116@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789545812.643437:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.116@tcp: connect to target with instance 0 00000100:00080000:2.0:1789545812.643446:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.116@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789545812.643452:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789545812.643456:0:3310:0:(import.c:65:import_set_state_nolock()) ffff994be43a4000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789545812.643460:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789545812.643471:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789545812.643479:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6de5819a-62ff-4f85-af03-c287b54b27c1:3310:1876474454954752:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789545812.654711:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789545812.656282:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789545812.724056:0:14405:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789545812.724263:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789545812.724270:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789545812.731610:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789545812.731633:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789545812.732435:0:14405:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789545812.732631:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789545812.732637:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789545812.733472:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789545812.733481:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789545812.734033:0:14405:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789545812.734201:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789545812.734207:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789545812.734704:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789545812.734711:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789545812.741519:0:14405:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789545812.741784:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789545812.741794:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789545812.755390:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789545812.755519:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789545812.779654:0:14405:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789545812.779894:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789545812.779903:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789545812.789245:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789545812.789260:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789545812.803727:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789545812.803747:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789545812.814706:0:14405:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789545812.814870:0:14405:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1789545812.814879:0:14405:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.116@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789545812.815040:0:14405:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.116@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789545812.815087:0:14405:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.116@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1789545812.815092:0:14405:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789545812.815094:0:14405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789545812.815095:0:14405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789545812.815096:0:14405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789545812.815097:0:14405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789545812.815099:0:14405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789545812.815100:0:14405:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789545812.815101:0:14405:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789545812.815103:0:14405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789545812.815105:0:14405:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789545812.815107:0:14405:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1789545812.815110:0:14405:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789545812.815111:0:14405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789545812.815112:0:14405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789545812.815113:0:14405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789545812.815114:0:14405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789545812.815115:0:14405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789545812.815117:0:14405:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789545812.815118:0:14405:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789545812.815119:0:14405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789545812.815120:0:14405:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789545812.815166:0:14405:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789545812.815190:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ede680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454954880:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789545812.815266:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545812.815356:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc644b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789545812.829655:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454954880 00000100:00100000:1.0:1789545812.829678:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454954880 00000100:00100000:1.0:1789545812.829780:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789545812.829793:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+5:14405:x1876474454954880:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789545812.829912:0:14418:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789545812.829915:0:14418:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789545812.829919:0:14418:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1789545812.832740:0:14439:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789545812.839266:0:14418:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1789545812.840850:0:14440:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1789545812.840858:0:14440:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1789545812.840861:0:14440:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1789545812.840895:0:14440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1789545812.842679:0:14418:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789545812.842692:0:14418:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789545812.860940:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+5:14405:x1876474454954880:12345-0@lo:253:mount.lustre.0 Request processed in 31141us (45665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545812.860975:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789545812.861158:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ede680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454954880:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789545812.861180:0:14405:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789545812.861184:0:14405:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789545812.861192:0:14405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789545812.861193:0:14405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789545812.861194:0:14405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789545812.861196:0:14405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789545812.861197:0:14405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789545812.861199:0:14405:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789545812.861201:0:14405:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789545812.861203:0:14405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789545812.861204:0:14405:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789545812.861231:0:14405:0:(tgt_mount.c:101:server_register_mount()) register mount ffff994bdfb81000 from lustre-MDT0000 10000000:01000000:2.0:1789545812.861266:0:14405:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789545812.861269:0:14405:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789545812.861273:0:14405:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff994bd8da3380 10000000:01000000:2.0:1789545812.861278:0:14405:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789545812.861287:0:14405:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff994bd8da3380 from 1 10000000:01000000:2.0:1789545812.861290:0:14405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789545812.861336:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d1400/0x64919c0f856c160d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545812.861348:0:14405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc49d1400/0x64919c0f856c160d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545812.861378:0:14405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc49d1400/0x64919c0f856c160d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545812.861400:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ede680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454955008:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789545812.861442:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545812.861484:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc593c540 going to sleep for 11 seconds 00000100:00100000:1.0:1789545812.861581:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454955008 00000100:00100000:1.0:1789545812.861588:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454955008 00000100:00100000:1.0:1789545812.861644:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789545812.861654:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+5:14405:x1876474454955008:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789545812.861668:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545812.861684:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc8ba8000/0x64919c0f856c1614 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c160d expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545812.861707:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc8ba8000/0x64919c0f856c1614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c160d expref: 6 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545812.861719:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc8ba8000/0x64919c0f856c1614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c160d expref: 6 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545812.861728:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba8000, rc 0) 00000100:00100000:1.0:1789545812.861774:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+6:14405:x1876474454955008:12345-0@lo:101:mount.lustre.0 Request processed in 121us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545812.861781:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789545812.861863:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ede680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454955008:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789545812.861877:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc49d1400/0x64919c0f856c160d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1614 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545812.861885:0:14405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc49d1400/0x64919c0f856c160d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c1614 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545812.861935:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be479b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454955136:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789545812.861962:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545812.861986:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8db1300 going to sleep for 11 seconds 00000100:00100000:2.0:1789545812.862042:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454955136 00000100:00100000:2.0:1789545812.862047:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454955136 00000100:00100000:2.0:1789545812.862078:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789545812.862095:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+6:14405:x1876474454955136:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789545812.862340:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+6:14405:x1876474454955136:12345-0@lo:501:mount.lustre.0 Request processed in 254us (375us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789545812.862353:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789545812.864255:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be479b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454955136:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789545812.864311:0:14405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789545812.864338:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d1400/0x64919c0f856c160d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1614 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545812.864350:0:14405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc49d1400/0x64919c0f856c160d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1614 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789545812.864422:0:14405:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff994bdfb81000 10000000:01000000:1.0:1789545812.864429:0:14405:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789545812.864435:0:14405:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff994bdfb81000 10000000:01000000:1.0:1789545812.864438:0:14405:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789545812.864441:0:14405:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff994bdfb81000 from 1 10000000:01000000:1.0:1789545812.864444:0:14405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789545812.864495:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9400/0x64919c0f856c161b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545812.864503:0:14405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9400/0x64919c0f856c161b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545812.864514:0:14405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9400/0x64919c0f856c161b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545812.864536:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f40e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454955264:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789545812.864595:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545812.864830:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff994ac2b539c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789545812.868689:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454955264 00000100:00100000:2.0:1789545812.868711:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454955264 00000100:00100000:2.0:1789545812.868791:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789545812.868815:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+6:14405:x1876474454955264:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789545812.868836:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545812.868871:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc49d1000/0x64919c0f856c1622 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c161b expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545812.868906:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc49d1000/0x64919c0f856c1622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c161b expref: 7 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545812.868919:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc49d1000/0x64919c0f856c1622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c161b expref: 7 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545812.868928:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1000, rc 0) 00000100:00100000:2.0:1789545812.869045:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+7:14405:x1876474454955264:12345-0@lo:101:mount.lustre.0 Request processed in 244us (4449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545812.869052:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789545812.869192:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f40e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454955264:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789545812.869214:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9400/0x64919c0f856c161b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1622 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545812.869224:0:14405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9400/0x64919c0f856c161b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c1622 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789545812.869262:0:14405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789545812.869284:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9400/0x64919c0f856c161b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1622 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545812.869292:0:14405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9400/0x64919c0f856c161b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1622 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789545812.869300:0:14405:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789545812.869304:0:14405:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789545812.869310:0:14405:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff994bdfb81000 10000000:01000000:0.0:1789545812.869313:0:14405:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789545812.869317:0:14405:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789545812.869320:0:14405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789545812.869349:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994be4eb7400/0x64919c0f856c1629 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545812.869384:0:14405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994be4eb7400/0x64919c0f856c1629 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545812.869393:0:14405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994be4eb7400/0x64919c0f856c1629 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545812.869415:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4799180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454955392:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789545812.869457:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545812.869518:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8db1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789545812.871926:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454955392 00000100:00100000:1.0:1789545812.871944:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454955392 00000100:00100000:1.0:1789545812.872013:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789545812.872023:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc6572450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+7:14405:x1876474454955392:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789545812.872039:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545812.872056:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc8ba9e00/0x64919c0f856c1630 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c1629 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545812.872081:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc8ba9e00/0x64919c0f856c1630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c1629 expref: 8 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545812.872117:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc8ba9e00/0x64919c0f856c1630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c1629 expref: 8 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545812.872127:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba9e00, rc 0) 00000100:00100000:1.0:1789545812.872206:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc6572450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+8:14405:x1876474454955392:12345-0@lo:101:mount.lustre.0 Request processed in 185us (2748us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545812.872213:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789545812.872327:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4799180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454955392:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789545812.872347:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994be4eb7400/0x64919c0f856c1629 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1630 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545812.872391:0:14405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994be4eb7400/0x64919c0f856c1629 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c1630 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545812.872463:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4799180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454955520:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789545812.872493:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545812.872523:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8db1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789545812.872591:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454955520 00000100:00100000:1.0:1789545812.872595:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454955520 00000100:00100000:1.0:1789545812.872615:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789545812.872621:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc6571c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+8:14405:x1876474454955520:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789545812.873022:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc6571c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+9:14405:x1876474454955520:12345-0@lo:501:mount.lustre.0 Request processed in 400us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545812.873029:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789545812.873207:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4799180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454955520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789545812.873250:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454955648:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789545812.873298:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545812.873614:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc4a45600 going to sleep for 11 seconds 00000100:00100000:1.0:1789545812.875058:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454955648 00000100:00100000:1.0:1789545812.875071:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454955648 00000100:00100000:1.0:1789545812.875120:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789545812.875129:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdb2f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+9:14405:x1876474454955648:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789545812.875728:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdb2f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+9:14405:x1876474454955648:12345-0@lo:503:mount.lustre.0 Request processed in 597us (2427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545812.875736:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789545812.877279:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454955648:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789545812.878817:0:14441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f41180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6de5819a-62ff-4f85-af03-c287b54b27c1:14441:1876474454955776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789545812.878900:0:14441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545812.878954:0:14441:0:(client.c:2716:ptlrpc_set_wait()) set ffff994ac2b53d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789545812.878987:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454955776 00000100:00100000:2.0:1789545812.878996:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454955776 00000100:00100000:2.0:1789545812.879055:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789545812.879067:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdb2f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+9:14441:x1876474454955776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789545812.879637:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdb2f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+9:14441:x1876474454955776:12345-0@lo:502:llog_process_th.0 Request processed in 571us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545812.879645:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789545812.879741:0:14441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f41180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6de5819a-62ff-4f85-af03-c287b54b27c1:14441:1876474454955776:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789545812.880019:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789545812.880038:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545812.880041:0:14441:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789545812.880049:0:14441:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789545812.880051:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789545812.880065:0:14441:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff994beddc4d40) 00000020:00000080:2.0:1789545812.880085:0:14441:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789545812.880090:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789545812.880164:0:14441:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789545812.880170:0:14441:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x64919c0f856c163e 00000020:00000080:2.0:1789545812.880415:0:14441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789545812.880418:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789545812.880422:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545812.880423:0:14441:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789545812.880425:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789545812.880428:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545812.880430:0:14441:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789545812.880432:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789545812.880439:0:14441:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff994beddc3380) 00000020:00000080:2.0:1789545812.880448:0:14441:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789545812.880451:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789545812.880453:0:14441:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789545812.880456:0:14441:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789545812.880461:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789545812.880497:0:14441:0:(tgt_mount.c:153:server_get_mount()) get mount ffff994bdfb81000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789545812.880507:0:14441:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff994beddc19c0) 00000020:00000080:2.0:1789545812.880513:0:14441:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789545812.880566:0:14441:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789545812.880571:0:14441:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x64919c0f856c1653 00000020:00000080:2.0:1789545812.880652:0:14441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789545812.880658:0:14441:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789545812.880661:0:14441:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x64919c0f856c165a 00080000:01000000:2.0:1789545812.880666:0:14441:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789545812.880669:0:14441:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x64919c0f856c1661 00010000:00010000:0.0:1789545813.022023:0:14441:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1789545813.022688:0:14441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:0.0:1789545813.022918:0:14441:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789545813.023760:0:14441:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff994bd08399c0) 00000020:00000080:0.0:1789545813.023782:0:14441:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789545813.023879:0:14441:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789545813.023887:0:14441:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x64919c0f856c166f 00000020:00000080:1.0:1789545813.024558:0:14441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789545813.029714:0:14441:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x64919c0f856c1676 00000020:00000080:1.0:1789545813.031139:0:14441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789545813.031155:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789545813.031162:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789545813.031164:0:14441:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789545813.031170:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789545813.031173:0:14441:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1789545813.031175:0:14441:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789545813.031177:0:14441:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789545813.031179:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789545813.031182:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789545813.031183:0:14441:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789545813.031186:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789545813.031193:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789545813.031194:0:14441:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789545813.031199:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789545813.031244:0:14441:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789545813.031260:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789545813.031264:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789545813.031265:0:14441:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789545813.031268:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789545813.031271:0:14441:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789545813.031275:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789545813.031276:0:14441:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789545813.031279:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789545813.031286:0:14441:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.116@tcp to nid 0x20000c0a8c974 (192.168.201.116@tcp) 00000020:01000000:1.0:1789545813.031316:0:14441:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789545813.031319:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789545813.031336:0:14441:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff994bc65d8000) 00000020:00000080:1.0:1789545813.031353:0:14441:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1789545813.031378:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789545813.031451:0:14441:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789545813.031458:0:14441:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789545813.031465:0:14441:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x64919c0f856c1684 00010000:00080000:1.0:1789545813.031502:0:14441:0:(ldlm_lib.c:102:import_set_conn()) imp ffff994bc2e68000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.116@tcp at head 00010000:00010000:1.0:1789545813.031727:0:14441:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1789545813.032125:0:14441:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789545813.032171:0:14441:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789545813.033166:0:14441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789545813.033232:0:14441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789545813.033298:0:14441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1789545813.034484:0:14445:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789545813.034497:0:14445:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789545813.036794:0:14441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789545813.036847:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789545813.036896:0:14441:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789545813.036921:0:14441:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x64919c0f856c168b 00000100:00080000:2.0:1789545813.036934:0:14441:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789545813.036947:0:14441:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff994bc2e68000 using connection 192.168.201.116@tcp/0@lo 00000100:00100000:2.0:1789545813.036988:0:14441:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994be4eddf80 x1876474454955904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789545813.037087:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876474454955904:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789545813.037156:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876474454955904 offset 0 length 520: 4 00000100:00080000:2.0:1789545813.037522:0:14441:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789545813.037590:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789545813.037595:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545813.037598:0:14441:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789545813.037601:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789545813.037605:0:14441:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1789545813.037606:0:14441:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789545813.037608:0:14441:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789545813.037609:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789545813.037612:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545813.037614:0:14441:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789545813.037616:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789545813.037620:0:14441:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789545813.037633:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545813.037634:0:14441:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789545813.037637:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789545813.037642:0:14441:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.116@tcp to nid 0x20000c0a8c974 (192.168.201.116@tcp) 00000020:01000000:2.0:1789545813.037667:0:14441:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789545813.037670:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789545813.037684:0:14441:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff994beddc0000) 00000020:00000080:2.0:1789545813.037700:0:14441:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1789545813.037705:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789545813.039040:0:14441:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789545813.039051:0:14441:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789545813.039065:0:14441:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x64919c0f856c1699 00010000:00080000:2.0:1789545813.039118:0:14441:0:(ldlm_lib.c:102:import_set_conn()) imp ffff994bc8ff8800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.116@tcp at head 00010000:00010000:2.0:1789545813.039761:0:14441:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1789545813.039996:0:14441:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789545813.040027:0:14441:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789545813.043738:0:14441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789545813.043854:0:14441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789545813.043932:0:14441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1789545813.044884:0:14447:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789545813.044890:0:14447:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789545813.047842:0:14441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789545813.047860:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789545813.047901:0:14441:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789545813.047925:0:14441:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x64919c0f856c16a0 00000100:00080000:2.0:1789545813.047936:0:14441:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789545813.047947:0:14441:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff994bc8ff8800 using connection 192.168.201.116@tcp/0@lo 00000100:00100000:2.0:1789545813.047988:0:14441:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994be4eded80 x1876474454956032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789545813.048053:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876474454956032:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789545813.048188:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876474454956032 offset 0 length 520: 4 00000100:00080000:2.0:1789545813.048316:0:14441:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789545813.048425:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789545813.048430:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545813.048442:0:14441:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789545813.048446:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789545813.048450:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545813.048452:0:14441:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789545813.048454:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789545813.048456:0:14441:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789545813.048459:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789545813.048461:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545813.048470:0:14441:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789545813.048473:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789545813.048476:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545813.048477:0:14441:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789545813.048480:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789545813.048511:0:14441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ede680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6de5819a-62ff-4f85-af03-c287b54b27c1:14441:1876474454956160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789545813.048568:0:14441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545813.048598:0:14441:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8c38f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789545813.049026:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454956160 00000100:00100000:2.0:1789545813.049035:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454956160 00000100:00100000:2.0:1789545813.049167:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789545813.049180:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdb2f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+9:14441:x1876474454956160:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789545813.049844:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdb2f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+9:14441:x1876474454956160:12345-0@lo:502:llog_process_th.0 Request processed in 664us (1272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545813.049855:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789545813.049956:0:14441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ede680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6de5819a-62ff-4f85-af03-c287b54b27c1:14441:1876474454956160:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789545813.049993:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789545813.050001:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789545813.050003:0:14441:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789545813.050008:0:14441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1789545813.050942:0:14405:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1789545813.050968:0:14405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789545813.051064:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994be4eb7400/0x64919c0f856c1629 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1630 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545813.051075:0:14405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994be4eb7400/0x64919c0f856c1629 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1630 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789545813.051272:0:14405:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff994bdfb81000 from 1 10000000:01000000:1.0:1789545813.051277:0:14405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789545813.051329:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8e00/0x64919c0f856c16a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545813.051339:0:14405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8e00/0x64919c0f856c16a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545813.051349:0:14405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8e00/0x64919c0f856c16a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545813.051393:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f41180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454956288:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789545813.051466:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545813.051515:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff994becff1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789545813.051522:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454956288 00000100:00100000:2.0:1789545813.051529:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454956288 00000100:00100000:2.0:1789545813.051566:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789545813.051576:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdb2f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+9:14405:x1876474454956288:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789545813.051590:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545813.051605:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc49d1600/0x64919c0f856c16ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c16a7 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545813.051754:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc49d1600/0x64919c0f856c16ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c16a7 expref: 10 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545813.051763:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc49d1600/0x64919c0f856c16ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c16a7 expref: 10 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545813.051783:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1600, rc 0) 00000100:00100000:2.0:1789545813.051834:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdb2f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+10:14405:x1876474454956288:12345-0@lo:101:mount.lustre.0 Request processed in 260us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545813.051840:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789545813.051956:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f41180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454956288:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789545813.051970:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8e00/0x64919c0f856c16a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c16ae expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545813.051980:0:14405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8e00/0x64919c0f856c16a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c16ae expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545813.052768:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f41180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454956416:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789545813.052833:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545813.052871:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454956416 00000100:00100000:1.0:1789545813.052874:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff994becff1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789545813.052878:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454956416 00000100:00100000:2.0:1789545813.052914:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789545813.052923:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd93cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+10:14405:x1876474454956416:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789545813.052941:0:14417:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789545813.052946:0:14417:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789545813.053026:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd93cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+10:14405:x1876474454956416:12345-0@lo:256:mount.lustre.0 Request processed in 103us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545813.053034:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789545813.053060:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f41180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454956416:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789545813.053925:0:14405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789545813.053939:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8e00/0x64919c0f856c16a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c16ae expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545813.053951:0:14405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8e00/0x64919c0f856c16a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c16ae expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789545813.053959:0:14405:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994bdfb81000 from 1 10000000:01000000:1.0:1789545813.053962:0:14405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789545813.054529:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9200/0x64919c0f856c16b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545813.054541:0:14405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9200/0x64919c0f856c16b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545813.054563:0:14405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9200/0x64919c0f856c16b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545813.054587:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f41180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454956544:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789545813.054640:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545813.054690:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff994becff1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789545813.054692:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454956544 00000100:00100000:2.0:1789545813.054699:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454956544 00000100:00100000:2.0:1789545813.054736:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789545813.054745:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd93ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+10:14405:x1876474454956544:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789545813.054758:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545813.054772:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc49d0c00/0x64919c0f856c16bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c16b5 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545813.054789:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc49d0c00/0x64919c0f856c16bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c16b5 expref: 11 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545813.054797:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc49d0c00/0x64919c0f856c16bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c16b5 expref: 11 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545813.054827:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0c00, rc 0) 00000100:00100000:2.0:1789545813.054870:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd93ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+11:14405:x1876474454956544:12345-0@lo:101:mount.lustre.0 Request processed in 126us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545813.054876:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789545813.054980:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f41180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454956544:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789545813.054999:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9200/0x64919c0f856c16b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c16bc expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545813.055005:0:14405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9200/0x64919c0f856c16b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c16bc expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545813.055053:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f41180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454956672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789545813.055071:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545813.055095:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff994becff1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789545813.055171:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454956672 00000100:00100000:2.0:1789545813.055175:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454956672 00000100:00100000:2.0:1789545813.055196:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789545813.055203:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd93cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+11:14405:x1876474454956672:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789545813.055976:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd93cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+11:14405:x1876474454956672:12345-0@lo:501:mount.lustre.0 Request processed in 772us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545813.055982:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789545813.056033:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f41180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454956672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789545813.056067:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f41180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454956800:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789545813.056107:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545813.056157:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff994becff1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789545813.056285:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454956800 00000100:00100000:2.0:1789545813.056289:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454956800 00000100:00100000:2.0:1789545813.056315:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789545813.056323:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd93ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+11:14405:x1876474454956800:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789545813.056980:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd93ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+11:14405:x1876474454956800:12345-0@lo:503:mount.lustre.0 Request processed in 654us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545813.056988:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789545813.057062:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f41180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454956800:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789545813.057910:0:14449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6de5819a-62ff-4f85-af03-c287b54b27c1:14449:1876474454956928:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789545813.057968:0:14449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545813.058037:0:14449:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc4a45780 going to sleep for 11 seconds 00000100:00100000:2.0:1789545813.058138:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454956928 00000100:00100000:2.0:1789545813.058143:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454956928 00000100:00100000:2.0:1789545813.058176:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789545813.058185:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd93cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+11:14449:x1876474454956928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789545813.058785:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd93cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+11:14449:x1876474454956928:12345-0@lo:502:llog_process_th.0 Request processed in 598us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545813.058794:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789545813.058902:0:14449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6de5819a-62ff-4f85-af03-c287b54b27c1:14449:1876474454956928:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789545813.058934:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789545813.058945:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789545813.058948:0:14449:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789545813.058954:0:14449:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff994bdfb81000 00000020:00000080:3.0:1789545813.058957:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789545813.058965:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789545813.058968:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789545813.058969:0:14449:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789545813.058971:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789545813.058973:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789545813.058980:0:14449:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789545813.058984:0:14449:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff994bdfb81000 00000020:00000080:3.0:1789545813.058986:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789545813.059115:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789545813.059119:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789545813.059120:0:14449:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789545813.059122:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789545813.059124:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789545813.059125:0:14449:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789545813.059127:0:14449:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff994bdfb81000 00000020:00000080:3.0:1789545813.059128:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789545813.060941:0:14449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6de5819a-62ff-4f85-af03-c287b54b27c1:14449:1876474454957056:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789545813.061022:0:14449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545813.061073:0:14449:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc4a45780 going to sleep for 11 seconds 00000100:00100000:1.0:1789545813.061175:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454957056 00000100:00100000:1.0:1789545813.061181:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454957056 00000100:00100000:1.0:1789545813.061239:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789545813.061249:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd93cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+11:14449:x1876474454957056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789545813.061568:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd93cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+11:14449:x1876474454957056:12345-0@lo:502:llog_process_th.0 Request processed in 320us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545813.061576:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789545813.061949:0:14449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6de5819a-62ff-4f85-af03-c287b54b27c1:14449:1876474454957056:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789545813.061979:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789545813.061987:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789545813.061990:0:14449:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789545813.061994:0:14449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789545813.062178:0:14405:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789545813.062203:0:14405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789545813.062223:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9200/0x64919c0f856c16b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c16bc expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545813.062314:0:14405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9200/0x64919c0f856c16b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c16bc expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789545813.062564:0:14405:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789545813.062568:0:14405:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff994bdfb81000 10000000:01000000:1.0:1789545813.062572:0:14405:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff994bdfb81000 10000000:01000000:1.0:1789545813.062576:0:14405:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789545813.062582:0:14405:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff994bdfb81000 from 1 10000000:01000000:1.0:1789545813.062585:0:14405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789545813.062620:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8400/0x64919c0f856c16c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545813.063162:0:14405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8400/0x64919c0f856c16c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545813.063176:0:14405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8400/0x64919c0f856c16c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545813.063199:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f41180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454957184:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789545813.063335:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545813.063609:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff994becff1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789545813.070728:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454957184 00000100:00100000:0.0:1789545813.070746:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454957184 00000100:00100000:0.0:1789545813.071700:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789545813.071714:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd93cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+11:14405:x1876474454957184:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789545813.071732:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545813.071754:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994be4eb6600/0x64919c0f856c16ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c16c3 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545813.071792:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994be4eb6600/0x64919c0f856c16ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c16c3 expref: 12 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545813.071814:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994be4eb6600/0x64919c0f856c16ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c16c3 expref: 12 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545813.071824:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb6600, rc 0) 00000100:00100000:0.0:1789545813.071926:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd93cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+12:14405:x1876474454957184:12345-0@lo:101:mount.lustre.0 Request processed in 215us (8591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545813.071934:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789545813.071958:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f41180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454957184:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789545813.071976:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8400/0x64919c0f856c16c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c16ca expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545813.071992:0:14405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8400/0x64919c0f856c16c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c16ca expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545813.072071:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454957312:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789545813.072109:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545813.072150:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc4a45540 going to sleep for 11 seconds 00000100:00100000:0.0:1789545813.073530:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454957312 00000100:00100000:0.0:1789545813.073548:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454957312 00000100:00100000:0.0:1789545813.073605:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789545813.073615:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd93ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+12:14405:x1876474454957312:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789545813.076038:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd93ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+12:14405:x1876474454957312:12345-0@lo:501:mount.lustre.0 Request processed in 2414us (3918us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545813.076053:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789545813.076374:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454957312:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789545813.076445:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454957440:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789545813.076514:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545813.076556:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc4a45540 going to sleep for 11 seconds 00000100:00100000:0.0:1789545813.078284:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454957440 00000100:00100000:0.0:1789545813.078298:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454957440 00000100:00100000:0.0:1789545813.078340:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789545813.078375:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd93cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+12:14405:x1876474454957440:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789545813.080352:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd93cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+12:14405:x1876474454957440:12345-0@lo:503:mount.lustre.0 Request processed in 1983us (3828us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545813.080383:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789545813.080437:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454957440:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789545813.081524:0:14453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6de5819a-62ff-4f85-af03-c287b54b27c1:14453:1876474454957568:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789545813.081590:0:14453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545813.081693:0:14453:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc4a45780 going to sleep for 11 seconds 00000100:00100000:0.0:1789545813.081736:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454957568 00000100:00100000:0.0:1789545813.081743:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454957568 00000100:00100000:0.0:1789545813.081789:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789545813.081807:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd93cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+12:14453:x1876474454957568:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789545813.082028:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd93cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+12:14453:x1876474454957568:12345-0@lo:502:llog_process_th.0 Request processed in 230us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545813.082035:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789545813.082782:0:14453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6de5819a-62ff-4f85-af03-c287b54b27c1:14453:1876474454957568:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1789545813.082862:0:14453:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789545813.082877:0:14453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff994be40a99c0) 00000020:00000080:3.0:1789545813.082897:0:14453:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1789545813.082978:0:14453:0:(tgt_mount.c:153:server_get_mount()) get mount ffff994bdfb81000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789545813.082998:0:14453:0:(tgt_mount.c:187:server_put_mount()) put mount ffff994bdfb81000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789545813.083001:0:14453:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994bdfb81000 4 00010000:00080000:3.0:1789545813.083027:0:14453:0:(ldlm_lib.c:102:import_set_conn()) imp ffff994bdf93d000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.116@tcp at head 00010000:00010000:3.0:1789545813.087109:0:14453:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1789545813.087332:0:14453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789545813.087391:0:14453:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789545813.087407:0:14453:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x64919c0f856c16d8 00000100:00080000:3.0:1789545813.087419:0:14453:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789545813.087432:0:14453:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff994bdf93d000 using connection 192.168.201.116@tcp/0@lo 00000100:00100000:3.0:1789545813.087467:0:14453:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994be4b3ea00 x1876474454957696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789545813.087506:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876474454957696:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789545813.087584:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789545813.087935:0:14453:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789545813.087962:0:12196:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789545813.087967:0:12196:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789545813.087970:0:12196:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789545813.087973:0:12196:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789545813.089304:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454957696 00000100:00100000:1.0:1789545813.089319:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454957696 00000100:00100000:3.0:1789545813.090779:0:14453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6de5819a-62ff-4f85-af03-c287b54b27c1:14453:1876474454957824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789545813.090885:0:14453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545813.090937:0:14453:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc4a45240 going to sleep for 11 seconds 00000100:00100000:3.0:1789545813.090964:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454957824 00000100:00100000:3.0:1789545813.090971:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454957824 00000100:00100000:3.0:1789545813.091025:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789545813.091033:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd93cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+12:14453:x1876474454957824:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789545813.091204:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789545813.091212:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1876474454957696:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789545813.091550:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd93cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+12:14453:x1876474454957824:12345-0@lo:502:llog_process_th.0 Request processed in 515us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545813.091558:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789545813.091689:0:14453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6de5819a-62ff-4f85-af03-c287b54b27c1:14453:1876474454957824:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789545813.091721:0:14453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789545813.091860:0:14405:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789545813.091877:0:14405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789545813.091903:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8400/0x64919c0f856c16c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c16ca expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545813.091913:0:14405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8400/0x64919c0f856c16c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c16ca expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789545813.091971:0:14405:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789545813.091974:0:14405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789545813.091975:0:14405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789545813.091976:0:14405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789545813.091977:0:14405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789545813.091979:0:14405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789545813.091980:0:14405:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789545813.091981:0:14405:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789545813.091983:0:14405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789545813.091984:0:14405:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789545813.091987:0:14405:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1789545813.091989:0:14405:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789545813.091991:0:14405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789545813.091992:0:14405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789545813.091993:0:14405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789545813.091994:0:14405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789545813.091995:0:14405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789545813.091995:0:14405:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789545813.091996:0:14405:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789545813.091997:0:14405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789545813.091998:0:14405:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789545813.092015:0:14405:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789545813.092027:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454957952:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789545813.092058:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545813.092075:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc4a45240 going to sleep for 11 seconds 00000100:00100000:1.0:1789545813.093069:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1876474454957696:12345-0@lo:38:llog_process_th.0 Request processed in 1850us (5479us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789545813.093152:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789545813.093601:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454957952 00000100:00100000:0.0:1789545813.093613:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454957952 00000100:00100000:0.0:1789545813.094197:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789545813.094211:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd93cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+12:14405:x1876474454957952:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789545813.094329:0:14417:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789545813.094354:0:14417:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789545813.095299:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789545813.095311:0:3310:0:(import.c:65:import_set_state_nolock()) ffff994bdf93d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789545813.095316:0:3310:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789545813.095320:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876474454957696:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1789545813.146948:0:14417:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789545813.146964:0:14417:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1789545813.146985:0:14439:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789545813.146990:0:14439:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789545813.147012:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff994bc8ba8800/0x64919c0f856c16df lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545813.147032:0:14439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bc49d1600/0x64919c0f856c16ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c16a7 expref: 12 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545813.147041:0:14439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff994bc8ba8800/0x64919c0f856c16df lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545813.147082:0:14439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bc49d1600/0x64919c0f856c16ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c16a7 expref: 12 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545813.147096:0:14439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994bc49d1600/0x64919c0f856c16ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c16a7 expref: 12 pid: 14418 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545813.147111:0:14439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f43100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14439:1876474454958080:0@lo:104: 00000100:00100000:1.0:1789545813.147184:0:14439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545813.147414:0:14439:0:(client.c:2716:ptlrpc_set_wait()) set ffff994becff10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789545813.147543:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454958080 00000100:00100000:0.0:1789545813.147552:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454958080 00000100:00100000:0.0:1789545813.147596:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789545813.147606:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6de5819a-62ff-4f85-af03-c287b54b27c1+3:14439:x1876474454958080:12345-0@lo:104: 00010000:00010000:0.0:1789545813.147632:0:14406:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8e00/0x64919c0f856c16a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c16ae expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545813.147748:0:14406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789545813.147755:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6de5819a-62ff-4f85-af03-c287b54b27c1+3:14439:x1876474454958080:12345-0@lo:104: Request processed in 151us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545813.147763:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789545813.147784:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789545813.147791:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8e00/0x64919c0f856c16a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c16ae expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545813.147811:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba8e00 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:0.0:1789545813.147816:0:14412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8e00/0x64919c0f856c16a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c16ae expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545813.147840:0:14412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8e00/0x64919c0f856c16a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c16ae expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789545813.147849:0:14412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8e00/0x64919c0f856c16a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c16ae expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789545813.147854:0:14412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789545813.147894:0:14412:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8e00/0x64919c0f856c16a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c16ae expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545813.147900:0:14412:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789545813.147921:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8e00/0x64919c0f856c16a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c16ae expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545813.147929:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8e00/0x64919c0f856c16a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c16ae expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545813.147945:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545813.147947:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545813.147948:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545813.147973:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be479a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6de5819a-62ff-4f85-af03-c287b54b27c1:3311:1876474454958208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789545813.148003:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545813.148133:0:14439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f43100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14439:1876474454958080:0@lo:104: 00000100:00100000:1.0:1789545813.148145:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454958208 00000100:00100000:1.0:1789545813.148150:0:14408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454958208 00010000:00010000:2.0:1789545813.148157:0:14439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff994bc8ba8800/0x64919c0f856c16df lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545813.148168:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bc49d1600/0x64919c0f856c16ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c16a7 expref: 13 pid: 14418 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545813.148190:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789545813.148205:0:14408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be479ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6de5819a-62ff-4f85-af03-c287b54b27c1+13:3311:x1876474454958208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789545813.148217:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545813.148225:0:14408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bc49d1600/0x64919c0f856c16ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c16a7 expref: 13 pid: 14418 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545813.148236:0:14408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bc49d1600/0x64919c0f856c16ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c16a7 expref: 13 pid: 14418 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545813.148250:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc49d1600/0x64919c0f856c16ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c16a7 expref: 13 pid: 14418 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545813.148265:0:14408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff994bc8ba8800/0x64919c0f856c16df lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545813.148275:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc8ba8800/0x64919c0f856c16df lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789545813.148290:0:14408:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001300560s 00010000:00010000:1.0:1789545813.148295:0:14408:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994bc8ba8800/0x64919c0f856c16df lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545813.148302:0:14408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994bc8ba8800/0x64919c0f856c16df lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545813.148310:0:14408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff994bc8ba8800/0x64919c0f856c16df lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545813.148317:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff994bc8ba8800/0x64919c0f856c16df lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545813.148323:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba8800 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:1.0:1789545813.148334:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff994bc8ba8800/0x64919c0f856c16df lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545813.148341:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff994bc8ba8800/0x64919c0f856c16df lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545813.148403:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff994bc8ba8800/0x64919c0f856c16df lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545813.148410:0:14439:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff994bc8ba8800/0x64919c0f856c16df lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545813.148414:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789545813.148417:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff994bc8ba8800/0x64919c0f856c16df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545813.148424:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc8ba8800/0x64919c0f856c16df lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545813.148484:0:14409:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789545813.148493:0:14409:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1789545813.148602:0:14408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be479ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6de5819a-62ff-4f85-af03-c287b54b27c1+12:3311:x1876474454958208:12345-0@lo:103:ldlm_bl.0 Request processed in 398us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545813.148609:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789545813.148646:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be479a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6de5819a-62ff-4f85-af03-c287b54b27c1:3311:1876474454958208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789545813.166307:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd93cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+11:14405:x1876474454957952:12345-0@lo:253:mount.lustre.0 Request processed in 72086us (74236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545813.166322:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789545813.166342:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:14405:1876474454957952:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789545813.166381:0:14405:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789545813.166386:0:14405:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789545813.166387:0:14405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789545813.166389:0:14405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789545813.166390:0:14405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789545813.166391:0:14405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789545813.166392:0:14405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789545813.166394:0:14405:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789545813.166396:0:14405:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789545813.166398:0:14405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789545813.166400:0:14405:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789545813.166416:0:14405:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789545813.173975:0:14405:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789545813.174172:0:14405:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789545813.174675:0:14405:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789545813.174809:0:14405:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789545813.175023:0:14405:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789545813.175546:0:14405:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1789545813.176768:0:14405:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1789545813.177038:0:14405:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1789545813.177998:0:14405:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1789545813.178784:0:14405:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1789545813.179061:0:14405:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1789545813.185452:0:14405:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1789545813.215693:0:14405:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1789545813.216242:0:14405:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1789545813.216301:0:14461:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1789545813.216305:0:14461:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1789545813.217064:0:14462:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1789545813.217184:0:14462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789545813.219223:0:14462:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789545813.219290:0:14462:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789545813.219294:0:14462:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1789545813.221144:0:14405:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789545813.221504:0:14405:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789545813.221963:0:14405:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789545813.221974:0:14405:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789545813.222126:0:14405:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789545813.223682:0:14405:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789545813.224275:0:14405:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789545813.224321:0:14405:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1789545813.225766:0:14405:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1789545813.232342:0:14405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789545813.271598:0:14405:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789545813.271641:0:14405:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa450017d3988 00100000:10000000:3.0:1789545813.271653:0:14405:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789545813.272808:0:14405:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789545813.272829:0:14405:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.116@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789545813.272845:0:14405:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789545813.272875:0:14405:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1789545813.571723:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789545814.018111:0:14420:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789545814.018122:0:14420:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff994bdfb81000 from 6 10000000:01000000:0.0:1789545814.018128:0:14420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789545814.018183:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c16e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545814.018206:0:14420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c16e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545814.018221:0:14420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c16e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545814.018264:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4799f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454958336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789545814.018355:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545814.018476:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8db1540 going to sleep for 11 seconds 00000100:00100000:3.0:1789545814.019898:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454958336 00000100:00100000:3.0:1789545814.019955:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454958336 00000100:00100000:3.0:1789545814.020025:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789545814.020036:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd93cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+11:14420:x1876474454958336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789545814.020051:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545814.020073:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bee11a000/0x64919c0f856c16ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c16e6 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545814.020098:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bee11a000/0x64919c0f856c16ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c16e6 expref: 12 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545814.020110:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bee11a000/0x64919c0f856c16ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c16e6 expref: 12 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545814.020120:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bee11a000, rc 0) 00000100:00100000:2.0:1789545814.020318:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4799f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454958336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789545814.020336:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c16e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c16ed expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545814.020347:0:14420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c16e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c16ed expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545814.020458:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454958464:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789545814.020509:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545814.020538:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bfbf4dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789545814.020917:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454958464 00000100:00100000:1.0:1789545814.020924:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454958464 00000100:00100000:1.0:1789545814.020950:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789545814.020957:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd93ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+13:14420:x1876474454958464:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789545814.020984:0:14418:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789545814.020997:0:14418:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789545814.021000:0:14418:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1789545814.021089:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd93ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+13:14420:x1876474454958464:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545814.021097:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789545814.021173:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd93cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+12:14420:x1876474454958336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1138us (2816us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545814.021179:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789545814.021426:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454958464:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789545814.021472:0:14420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789545814.021481:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c16e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c16ed expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545814.021502:0:14420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c16e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c16ed expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789545814.141014:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789545814.589215:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789545815.165851:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789545815.615372:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545816.638054:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545817.664807:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789545818.052605:0:14705:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg116-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1789545818.176795:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6de5819a-62ff-4f85-af03-c287b54b27c1:3312:1876474454958592:0@lo:400:kworker.0 00000100:00100000:3.0:1789545818.176869:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545818.176993:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454958592 00000100:00100000:0.0:1789545818.177003:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454958592 00000100:00100000:0.0:1789545818.177051:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789545818.177061:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd93cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+12:3312:x1876474454958592:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789545818.178391:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789545818.178399:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789545818.178401:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789545818.178404:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789545818.178407:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789545818.178410:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789545818.178414:0:36:0:(import.c:65:import_set_state_nolock()) ffff994bdf93d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789545818.178429:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff994bdf93d000 using connection 192.168.201.116@tcp/0@lo 00000100:00100000:2.0:1789545818.178460:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994be4edf800 x1876474454958720/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789545818.178522:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876474454958720:0@lo:38:kworker.0 00000100:00100000:2.0:1789545818.178606:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545818.178862:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454958720 00000100:00100000:1.0:1789545818.178870:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454958720 00000100:00100000:1.0:1789545818.178898:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789545818.178906:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1876474454958720:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789545818.178932:0:14425:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 432 last 0 00000020:00000080:1.0:1789545818.178970:0:14425:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x64919c0f856c16f4 00000004:00100000:1.0:1789545818.178986:0:14425:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789545818.179115:0:14425:0:(import.c:65:import_set_state_nolock()) ffff994be41f9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789545818.179170:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876474454958720:12345-0@lo:38:kworker.0 Request processed in 263us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545818.179178:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789545818.179417:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff994be4edf800 x1876474454958720/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789545828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789545818.179433:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789545818.179441:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789545818.179446:0:3310:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789545818.179448:0:3310:0:(import.c:65:import_set_state_nolock()) ffff994bdf93d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789545818.179463:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876474454958720:0@lo:38:kworker.0 00000100:00100000:0.0:1789545818.181450:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd93cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+12:3312:x1876474454958592:12345-0@lo:400:kworker.0 Request processed in 4381us (4573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545818.181465:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789545818.188774:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6de5819a-62ff-4f85-af03-c287b54b27c1:3312:1876474454958592:0@lo:400:kworker.0 00010000:00010000:3.0:1789545818.684790:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545819.717455:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545820.737488:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789545821.344802:0:14857:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe93e2b540 20000000:00000080:2.0:1789545821.344821:0:14857:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff994bdaa7ac00 uarg=0000000000000000 20000000:01000000:2.0:1789545821.344853:0:14857:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789545821.344859:0:14857:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789545821.344864:0:14857:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789545821.346012:0:14858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1789545821.346301:0:14857:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789545821.352494:0:14857:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789545821.352525:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff994bc49d1a00/0x64919c0f856c16fb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545821.352545:0:14857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bc49d0c00/0x64919c0f856c16bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c16b5 expref: 11 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545821.352554:0:14857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff994bc49d1a00/0x64919c0f856c16fb lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545821.352598:0:14857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bc49d0c00/0x64919c0f856c16bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c16b5 expref: 11 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545821.352615:0:14857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994bc49d0c00/0x64919c0f856c16bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c16b5 expref: 11 pid: 14418 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545821.352630:0:14857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14857:1876474454958848:0@lo:104: 00000100:00100000:2.0:1789545821.352767:0:14857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545821.352857:0:14857:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bfbf4dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789545821.352900:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454958848 00000100:00100000:0.0:1789545821.352909:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454958848 00000100:00100000:0.0:1789545821.353049:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789545821.353061:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6de5819a-62ff-4f85-af03-c287b54b27c1+3:14857:x1876474454958848:12345-0@lo:104: 00010000:00010000:0.0:1789545821.353142:0:14406:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9200/0x64919c0f856c16b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c16bc expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545821.353214:0:14406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789545821.353220:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6de5819a-62ff-4f85-af03-c287b54b27c1+3:14857:x1876474454958848:12345-0@lo:104: Request processed in 162us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545821.353228:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789545821.353334:0:14857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14857:1876474454958848:0@lo:104: 00010000:00010000:1.0:1789545821.353353:0:14857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff994bc49d1a00/0x64919c0f856c16fb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545821.353516:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789545821.353524:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9200/0x64919c0f856c16b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c16bc expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545821.353532:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba9200 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:3.0:1789545821.353536:0:14411:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9200/0x64919c0f856c16b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c16bc expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545821.353544:0:14411:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9200/0x64919c0f856c16b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c16bc expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789545821.353552:0:14411:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9200/0x64919c0f856c16b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c16bc expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789545821.353557:0:14411:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789545821.353591:0:14411:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9200/0x64919c0f856c16b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c16bc expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545821.353598:0:14411:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789545821.353618:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9200/0x64919c0f856c16b5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c16bc expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545821.353626:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9200/0x64919c0f856c16b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c16bc expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545821.353644:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545821.353660:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545821.353662:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789545821.353705:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6de5819a-62ff-4f85-af03-c287b54b27c1:3313:1876474454958976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789545821.353742:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545821.353796:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454958976 00000100:00100000:3.0:1789545821.353801:0:14408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454958976 00010000:00010000:3.0:1789545821.353818:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bc49d0c00/0x64919c0f856c16bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c16b5 expref: 12 pid: 14418 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545821.353840:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789545821.353846:0:14408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6de5819a-62ff-4f85-af03-c287b54b27c1+12:3313:x1876474454958976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789545821.353857:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545821.353861:0:14408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bc49d0c00/0x64919c0f856c16bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c16b5 expref: 12 pid: 14418 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545821.353872:0:14408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bc49d0c00/0x64919c0f856c16bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c16b5 expref: 12 pid: 14418 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545821.353885:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc49d0c00/0x64919c0f856c16bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c16b5 expref: 12 pid: 14418 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545821.353898:0:14408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff994bc49d1a00/0x64919c0f856c16fb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545821.353906:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc49d1a00/0x64919c0f856c16fb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545821.353928:0:14408:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994bc49d1a00/0x64919c0f856c16fb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545821.353936:0:14408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994bc49d1a00/0x64919c0f856c16fb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545821.353948:0:14408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff994bc49d1a00/0x64919c0f856c16fb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545821.353955:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff994bc49d1a00/0x64919c0f856c16fb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545821.353960:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1a00 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545821.353964:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff994bc49d1a00/0x64919c0f856c16fb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545821.353972:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff994bc49d1a00/0x64919c0f856c16fb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545821.353983:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff994bc49d1a00/0x64919c0f856c16fb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545821.353991:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545821.354020:0:14408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6de5819a-62ff-4f85-af03-c287b54b27c1+11:3313:x1876474454958976:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545821.354027:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789545821.354057:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6de5819a-62ff-4f85-af03-c287b54b27c1:3313:1876474454958976:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789545821.354352:0:14857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff994bc49d1a00/0x64919c0f856c16fb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545821.354386:0:14857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff994bc49d1a00/0x64919c0f856c16fb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545821.354403:0:14857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc49d1a00/0x64919c0f856c16fb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545821.756970:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789545822.460479:0:14420:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789545822.460488:0:14420:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994bdfb81000 from 10 10000000:01000000:3.0:1789545822.460494:0:14420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789545822.460542:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bee11ae00/0x64919c0f856c1702 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545822.460556:0:14420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bee11ae00/0x64919c0f856c1702 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545822.460770:0:14420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bee11ae00/0x64919c0f856c1702 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545822.460800:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454959104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789545822.460869:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545822.460958:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfc400c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789545822.461006:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454959104 00000100:00100000:0.0:1789545822.461014:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454959104 00000100:00100000:0.0:1789545822.461108:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789545822.461118:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf58f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+11:14420:x1876474454959104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789545822.461141:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545822.461157:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994be4eb6e00/0x64919c0f856c1709 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c1702 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545822.461178:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994be4eb6e00/0x64919c0f856c1709 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c1702 expref: 12 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545822.461189:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994be4eb6e00/0x64919c0f856c1709 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c1702 expref: 12 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545822.461198:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb6e00, rc 0) 00000100:00100000:0.0:1789545822.461246:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf58f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+12:14420:x1876474454959104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545822.461252:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789545822.461328:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454959104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789545822.461342:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bee11ae00/0x64919c0f856c1702 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1709 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545822.461351:0:14420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bee11ae00/0x64919c0f856c1702 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c1709 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545822.461425:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454959232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789545822.461457:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545822.462536:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfc400c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789545822.462873:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454959232 00000100:00100000:2.0:1789545822.462882:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454959232 00000100:00100000:2.0:1789545822.462923:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789545822.462943:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf58f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+12:14420:x1876474454959232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789545822.463313:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf58f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+12:14420:x1876474454959232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 370us (1855us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545822.463321:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789545822.463466:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454959232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789545822.463512:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454959360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789545822.463555:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545822.463580:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfc400c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789545822.463786:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454959360 00000100:00100000:0.0:1789545822.463791:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454959360 00000100:00100000:0.0:1789545822.463817:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789545822.463825:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf58d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+12:14420:x1876474454959360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789545822.463973:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf58d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+12:14420:x1876474454959360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545822.463980:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789545822.464138:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454959360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789545822.465456:0:14918:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789545822.465934:0:14420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789545822.465953:0:14420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789545822.465963:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bee11ae00/0x64919c0f856c1702 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1709 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545822.465987:0:14420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bee11ae00/0x64919c0f856c1702 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1709 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545822.781764:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789545823.292941:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789545823.292948:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789545823.292951:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789545823.292962:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789545823.293004:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454959616:0@lo:400:kworker.0 00000100:00100000:0.0:1789545823.293074:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545823.293147:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454959616 00000100:00100000:0.0:1789545823.293155:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454959616 00000100:00100000:0.0:1789545823.293193:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789545823.293201:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be479bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454959616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545823.293246:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be479bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454959616:12345-0@lo:400:kworker.0 Request processed in 45us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545823.293252:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789545823.293288:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff994be4798000 x1876474454959616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545823.293302:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454959616:0@lo:400:kworker.0 00000100:00100000:3.0:1789545823.293388:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6de5819a-62ff-4f85-af03-c287b54b27c1:3314:1876474454959488:0@lo:400:kworker.0 00000100:00100000:3.0:1789545823.293422:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545823.293881:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454959488 00000100:00100000:0.0:1789545823.293886:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454959488 00000100:00100000:0.0:1789545823.293923:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789545823.293930:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf58e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+12:3314:x1876474454959488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545823.293965:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf58e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+12:3314:x1876474454959488:12345-0@lo:400:kworker.0 Request processed in 35us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545823.293971:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789545823.294057:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6de5819a-62ff-4f85-af03-c287b54b27c1:3314:1876474454959488:0@lo:400:kworker.0 00000100:00100000:3.0:1789545823.309246:0:3310:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789545813/real 1789545813] req@ffff994be4eded80 x1876474454956032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789545823 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545823.309278:0:3310:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff994be4eded80 x1876474454956032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789545823 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545823.309351:0:3310:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789545813/real 1789545813] req@ffff994be4eddf80 x1876474454955904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789545823 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545823.309396:0:3310:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff994be4eddf80 x1876474454955904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789545823 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789545823.309415:0:3310:0:(import.c:65:import_set_state_nolock()) ffff994bc8ff8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789545823.309434:0:3310:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789545823.309438:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876474454956032:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789545823.309451:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789545823.309456:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789545823.309458:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789545823.309473:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789545823.309475:0:36:0:(import.c:65:import_set_state_nolock()) ffff994bc8ff8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789545823.309479:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 426 00000100:00080000:3.0:1789545823.309484:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789545823.309496:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff994bc8ff8800 using connection 192.168.201.116@tcp/0@lo 00000100:00100000:3.0:1789545823.309533:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994be4b3c380 x1876474454959744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789545823.309559:0:3310:0:(import.c:65:import_set_state_nolock()) ffff994bc2e68000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789545823.309576:0:3310:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789545823.309579:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876474454955904:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1789545823.309608:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876474454959744:0@lo:8:kworker.0 00000400:00000100:3.0:1789545823.309671:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876474454959744 offset 0 length 520: 4 00000100:00080000:2.0:1789545823.309692:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789545823.309696:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789545823.309699:0:36:0:(import.c:65:import_set_state_nolock()) ffff994bc2e68000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789545823.309702:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 426 00000100:00080000:2.0:1789545823.309705:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789545823.309710:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff994bc2e68000 using connection 192.168.201.116@tcp/0@lo 00000100:00100000:2.0:1789545823.309725:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994be4edd880 x1876474454959872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789545823.311865:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876474454959872:0@lo:8:kworker.0 00000400:00000100:3.0:1789545823.311931:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876474454959872 offset 0 length 520: 4 00010000:00010000:2.0:1789545823.805741:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545824.831099:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789545825.405228:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789545825.852547:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789545825.964601:0:15106:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789545825.964606:0:15106:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1789545825.964728:0:15106:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff994becda0000 00000020:01000004:3.0:1789545825.964754:0:15106:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789545825.964806:0:15106:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789545825.964820:0:15106:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff994be40a8000) 00000020:00000080:3.0:1789545825.964835:0:15106:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789545825.995133:0:15106:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789545825.995356:0:15106:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789545825.996609:0:15106:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789545825.996909:0:15106:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789545825.997634:0:15106:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789545825.998128:0:15106:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 641: rc = 0 00100000:10000000:2.0:1789545825.998225:0:15106:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 641: rc = 0 00100000:10000000:2.0:1789545825.998318:0:15106:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 641: rc = 0 00100000:10000000:2.0:1789545825.999230:0:15106:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 782: rc = 0 00100000:10000000:2.0:1789545826.001552:0:15106:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 782: rc = 0 00100000:10000000:2.0:1789545826.001933:0:15106:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 782: rc = 0 00100000:10000000:2.0:1789545826.002331:0:15106:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 782: rc = 0 00100000:10000000:3.0:1789545826.005581:0:15106:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 782: rc = 0 00100000:10000000:3.0:1789545826.007592:0:15106:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 782: rc = 0 00000020:00000080:3.0:1789545826.008651:0:15106:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789545826.008664:0:15106:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789545826.008679:0:15106:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x64919c0f856c1717 00000020:01000004:3.0:1789545826.008689:0:15106:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789545826.008710:0:15106:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.116@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789545826.008713:0:15106:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789545826.008718:0:15106:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789545826.008722:0:15106:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789545826.008734:0:15106:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff994be40ab380) 00000020:00000080:3.0:1789545826.008819:0:15106:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1789545826.011198:0:15106:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789545826.011399:0:15106:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789545826.011406:0:15106:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789545826.014330:0:15106:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789545826.014343:0:15106:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789545826.025262:0:15106:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789545826.025275:0:15106:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789545826.027145:0:15106:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789545826.027351:0:15106:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789545826.027380:0:15106:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789545826.029015:0:15106:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789545826.029026:0:15106:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789545826.066019:0:15106:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789545826.067344:0:15106:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789545826.067352:0:15106:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789545826.069298:0:15106:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789545826.069311:0:15106:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789545826.072009:0:15106:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789545826.072024:0:15106:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789545826.074208:0:15106:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789545826.075723:0:15106:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789545826.075732:0:15106:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789545826.077103:0:15106:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789545826.077112:0:15106:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789545826.139086:0:15106:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789545826.141787:0:15106:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789545826.141797:0:15106:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789545826.146303:0:15106:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789545826.146318:0:15106:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789545826.147084:0:15106:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789545826.147116:0:15106:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1789545826.147123:0:15106:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.116@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789545826.162206:0:15106:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.116@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789545826.162247:0:15106:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.116@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789545826.162252:0:15106:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789545826.162254:0:15106:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789545826.162255:0:15106:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789545826.162257:0:15106:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789545826.162258:0:15106:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789545826.162259:0:15106:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789545826.162261:0:15106:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789545826.162263:0:15106:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789545826.162264:0:15106:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789545826.162268:0:15106:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789545826.162271:0:15106:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789545826.162272:0:15106:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789545826.162273:0:15106:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789545826.162274:0:15106:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789545826.162275:0:15106:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789545826.162276:0:15106:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789545826.162277:0:15106:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789545826.162278:0:15106:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789545826.162280:0:15106:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789545826.162308:0:15106:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789545826.162331:0:15106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4798000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454960000:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789545826.162442:0:15106:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545826.162595:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454960000 00000100:00100000:2.0:1789545826.162604:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454960000 00000100:00100000:2.0:1789545826.162652:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789545826.162662:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf58dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+12:15106:x1876474454960000:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789545826.162703:0:14416:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789545826.162707:0:14416:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1789545826.162710:0:14416:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789545826.163046:0:15106:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc4a45c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789545826.168183:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf58dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+12:15106:x1876474454960000:12345-0@lo:253:mount.lustre.0 Request processed in 5513us (5731us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545826.168199:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789545826.168470:0:15106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4798000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454960000:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789545826.168486:0:15106:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789545826.168490:0:15106:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789545826.168492:0:15106:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789545826.168493:0:15106:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789545826.168494:0:15106:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789545826.168496:0:15106:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789545826.168497:0:15106:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789545826.168499:0:15106:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789545826.168500:0:15106:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789545826.168501:0:15106:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789545826.168524:0:15106:0:(tgt_mount.c:101:server_register_mount()) register mount ffff994becda0000 from lustre-OST0000 10000000:01000000:2.0:1789545826.168724:0:15106:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789545826.168729:0:15106:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789545826.168737:0:15106:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff994bd8da3380 local copy 00010000:00010000:2.0:1789545826.168761:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d1400/0x64919c0f856c160d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1614 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545826.168995:0:15106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454960128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789545826.169040:0:15106:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545826.169084:0:15106:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bfbf4d540 going to sleep for 11 seconds 00000100:00100000:3.0:1789545826.169164:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454960128 00000100:00100000:3.0:1789545826.169171:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454960128 00000100:00100000:3.0:1789545826.169217:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789545826.169227:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf58c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+12:15106:x1876474454960128:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789545826.169595:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf58c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+12:15106:x1876474454960128:12345-0@lo:501:mount.lustre.0 Request processed in 368us (553us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789545826.169603:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789545826.169722:0:15106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454960128:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789545826.169739:0:15106:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789545826.169884:0:15106:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789545826.169891:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d1400/0x64919c0f856c160d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1614 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545826.169901:0:15106:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc49d1400/0x64919c0f856c160d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1614 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789545826.169921:0:15106:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff994becda0000 10000000:01000000:2.0:1789545826.169925:0:15106:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789545826.169930:0:15106:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff994bd8da3380 10000000:01000000:2.0:1789545826.169932:0:15106:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789545826.169936:0:15106:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff994bd8da3380 from 1 10000000:01000000:2.0:1789545826.169939:0:15106:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789545826.169963:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d0800/0x64919c0f856c1725 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545826.169972:0:15106:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc49d0800/0x64919c0f856c1725 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545826.169983:0:15106:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc49d0800/0x64919c0f856c1725 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545826.170008:0:15106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454960256:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789545826.170036:0:15106:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545826.170068:0:15106:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bfbf4d540 going to sleep for 11 seconds 00000100:00100000:3.0:1789545826.170125:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454960256 00000100:00100000:3.0:1789545826.170130:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454960256 00000100:00100000:3.0:1789545826.170552:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789545826.170571:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf58f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+12:15106:x1876474454960256:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789545826.170582:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545826.170599:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bee11b800/0x64919c0f856c172c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c1725 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545826.170635:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bee11b800/0x64919c0f856c172c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c1725 expref: 13 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545826.170647:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bee11b800/0x64919c0f856c172c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c1725 expref: 13 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545826.170656:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bee11b800, rc 0) 00000100:00100000:3.0:1789545826.170708:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf58f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+13:15106:x1876474454960256:12345-0@lo:101:mount.lustre.0 Request processed in 147us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545826.170715:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789545826.170787:0:15106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454960256:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789545826.170800:0:15106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc49d0800/0x64919c0f856c1725 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c172c expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545826.170809:0:15106:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc49d0800/0x64919c0f856c1725 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c172c expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789545826.170828:0:15106:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789545826.170849:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d0800/0x64919c0f856c1725 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c172c expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545826.170857:0:15106:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc49d0800/0x64919c0f856c1725 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c172c expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789545826.170865:0:15106:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789545826.170869:0:15106:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789545826.170873:0:15106:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789545826.170876:0:15106:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789545826.170892:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d0600/0x64919c0f856c1733 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545826.170899:0:15106:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc49d0600/0x64919c0f856c1733 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545826.170907:0:15106:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc49d0600/0x64919c0f856c1733 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545826.170928:0:15106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454960384:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789545826.170955:0:15106:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545826.173969:0:15106:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bfbf4d540 going to sleep for 11 seconds 00000100:00100000:1.0:1789545826.174105:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454960384 00000100:00100000:1.0:1789545826.174116:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454960384 00000100:00100000:1.0:1789545826.174184:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789545826.174193:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf58fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+13:15106:x1876474454960384:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789545826.174209:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545826.174227:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc8ba9800/0x64919c0f856c173a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c1733 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545826.174254:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc8ba9800/0x64919c0f856c173a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c1733 expref: 14 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545826.174278:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc8ba9800/0x64919c0f856c173a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c1733 expref: 14 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545826.174289:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba9800, rc 0) 00000100:00100000:1.0:1789545826.174391:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf58fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+14:15106:x1876474454960384:12345-0@lo:101:mount.lustre.0 Request processed in 199us (3435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545826.174398:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789545826.174665:0:15106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454960384:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789545826.174696:0:15106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc49d0600/0x64919c0f856c1733 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c173a expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545826.174707:0:15106:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc49d0600/0x64919c0f856c1733 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c173a expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789545826.177351:0:15106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789545826.178307:0:15106:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789545826.178609:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789545826.178660:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789545826.178702:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789545826.178755:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789545826.178793:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789545826.178837:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789545826.178910:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789545826.178918:0:15106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789545826.179004:0:15106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454960512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789545826.179079:0:15106:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545826.179274:0:15106:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfc40540 going to sleep for 11 seconds 00000100:00100000:1.0:1789545826.179429:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454960512 00000100:00100000:1.0:1789545826.179437:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454960512 00000100:00100000:1.0:1789545826.179543:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789545826.179554:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf58cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+14:15106:x1876474454960512:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789545826.180010:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf58cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+14:15106:x1876474454960512:12345-0@lo:501:mount.lustre.0 Request processed in 457us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545826.180019:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789545826.180124:0:15106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454960512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789545826.180160:0:15106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454960640:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789545826.180200:0:15106:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545826.180239:0:15106:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfc40540 going to sleep for 11 seconds 00000100:00100000:3.0:1789545826.180293:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454960640 00000100:00100000:3.0:1789545826.180298:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454960640 00000100:00100000:3.0:1789545826.180319:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789545826.180326:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf58e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+14:15106:x1876474454960640:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789545826.180666:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf58e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+14:15106:x1876474454960640:12345-0@lo:503:mount.lustre.0 Request processed in 339us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545826.180673:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789545826.180832:0:15106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454960640:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789545826.181321:0:15106:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789545826.181401:0:15106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454960768:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789545826.181444:0:15106:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545826.181473:0:15106:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfc40540 going to sleep for 11 seconds 00000100:00100000:3.0:1789545826.181595:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454960768 00000100:00100000:3.0:1789545826.181601:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454960768 00000100:00100000:3.0:1789545826.181629:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789545826.181637:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf58e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+14:15106:x1876474454960768:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789545826.181838:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf58e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+14:15106:x1876474454960768:12345-0@lo:502:mount.lustre.0 Request processed in 202us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545826.181846:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789545826.181934:0:15106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454960768:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789545826.182150:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789545826.182197:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789545826.182231:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789545826.182354:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789545826.182426:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789545826.182461:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789545826.182512:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789545826.182549:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789545826.182599:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1789545826.182648:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1789545826.182683:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1789545826.182733:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1789545826.182769:0:15106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454960896:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789545826.182819:0:15106:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545826.182848:0:15106:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfc40540 going to sleep for 11 seconds 00000100:00100000:3.0:1789545826.182921:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454960896 00000100:00100000:3.0:1789545826.182928:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454960896 00000100:00100000:3.0:1789545826.182964:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789545826.182972:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf58d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+14:15106:x1876474454960896:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789545826.183136:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf58d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+14:15106:x1876474454960896:12345-0@lo:502:mount.lustre.0 Request processed in 164us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545826.183143:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789545826.183227:0:15106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454960896:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789545826.183447:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1789545826.183457:0:15106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1789545826.184641:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789545826.184650:0:15120:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1789545826.184658:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545826.184666:0:15120:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789545826.184673:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789545826.184696:0:15120:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff994be6e38000) 00000020:00000080:2.0:1789545826.184718:0:15120:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789545826.184726:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789545826.184788:0:15120:0:(tgt_mount.c:153:server_get_mount()) get mount ffff994becda0000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789545826.184796:0:15120:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789545826.184802:0:15120:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x64919c0f856c1748 00010000:00010000:2.0:1789545826.188171:0:15120:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1789545826.188791:0:15120:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1789545826.193481:0:15120:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1789545826.194870:0:15120:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789545826.194883:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789545826.194890:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545826.194892:0:15120:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789545826.194896:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789545826.194899:0:15120:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1789545826.194900:0:15120:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789545826.194902:0:15120:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789545826.194903:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789545826.194906:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545826.194907:0:15120:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789545826.194910:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789545826.194912:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545826.194914:0:15120:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789545826.194917:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789545826.194919:0:15120:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789545826.194920:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789545826.194922:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545826.194923:0:15120:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789545826.194926:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789545826.194928:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545826.194929:0:15120:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789545826.194931:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789545826.194992:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789545826.194995:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789545826.194996:0:15120:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789545826.194999:0:15120:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1789545826.195151:0:15106:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1789545826.195183:0:15106:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789545826.195205:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d0600/0x64919c0f856c1733 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c173a expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545826.195217:0:15106:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc49d0600/0x64919c0f856c1733 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c173a expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789545826.195226:0:15106:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994becda0000 from 1 10000000:01000000:3.0:1789545826.195230:0:15106:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789545826.195278:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bee11be00/0x64919c0f856c174f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545826.195286:0:15106:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bee11be00/0x64919c0f856c174f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545826.195296:0:15106:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bee11be00/0x64919c0f856c174f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545826.195321:0:15106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454961024:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789545826.195422:0:15106:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545826.195464:0:15106:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bf56e7000 going to sleep for 11 seconds 00000100:00100000:2.0:1789545826.195600:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454961024 00000100:00100000:2.0:1789545826.195608:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454961024 00000100:00100000:2.0:1789545826.195655:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789545826.195666:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf58c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+14:15106:x1876474454961024:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789545826.195679:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545826.195691:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc49d0e00/0x64919c0f856c1756 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c174f expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545826.195713:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc49d0e00/0x64919c0f856c1756 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c174f expref: 15 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545826.195723:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc49d0e00/0x64919c0f856c1756 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c174f expref: 15 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545826.195732:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0e00, rc 0) 00000100:00100000:2.0:1789545826.195777:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf58c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+15:15106:x1876474454961024:12345-0@lo:101:mount.lustre.0 Request processed in 113us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545826.195784:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789545826.195867:0:15106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454961024:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789545826.195882:0:15106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bee11be00/0x64919c0f856c174f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1756 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545826.195900:0:15106:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bee11be00/0x64919c0f856c174f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c1756 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789545826.196554:0:15106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789545826.196893:0:15106:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789545826.197147:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789545826.197192:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789545826.199463:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789545826.199493:0:15106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789545826.199613:0:15106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454961152:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789545826.199685:0:15106:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545826.199842:0:15106:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bf56e7000 going to sleep for 11 seconds 00000100:00100000:0.0:1789545826.204406:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454961152 00000100:00100000:0.0:1789545826.204421:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454961152 00000100:00100000:0.0:1789545826.204491:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789545826.204500:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf58d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+15:15106:x1876474454961152:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789545826.204826:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf58d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+15:15106:x1876474454961152:12345-0@lo:501:mount.lustre.0 Request processed in 327us (5140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545826.204834:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789545826.204990:0:15106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454961152:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789545826.205042:0:15106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454961280:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789545826.205088:0:15106:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545826.205126:0:15106:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bf56e7000 going to sleep for 11 seconds 00000100:00100000:0.0:1789545826.206452:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454961280 00000100:00100000:0.0:1789545826.206463:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454961280 00000100:00100000:0.0:1789545826.206513:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789545826.206523:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+15:15106:x1876474454961280:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789545826.206755:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+15:15106:x1876474454961280:12345-0@lo:503:mount.lustre.0 Request processed in 232us (1665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545826.206763:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789545826.207142:0:15106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454961280:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789545826.208103:0:15106:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789545826.208183:0:15106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454961408:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789545826.208245:0:15106:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545826.208389:0:15106:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bf56e7000 going to sleep for 11 seconds 00000100:00100000:0.0:1789545826.208549:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454961408 00000100:00100000:0.0:1789545826.208557:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454961408 00000100:00100000:0.0:1789545826.208610:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789545826.208619:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf540850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+15:15106:x1876474454961408:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789545826.208814:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf540850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+15:15106:x1876474454961408:12345-0@lo:502:mount.lustre.0 Request processed in 195us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545826.208821:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789545826.208917:0:15106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454961408:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789545826.209159:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789545826.209206:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789545826.209252:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789545826.209304:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789545826.209338:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789545826.209429:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789545826.209464:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789545826.209505:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1789545826.209537:0:15106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454961536:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789545826.209594:0:15106:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545826.209621:0:15106:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfc40e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789545826.209798:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454961536 00000100:00100000:0.0:1789545826.209805:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454961536 00000100:00100000:0.0:1789545826.209843:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789545826.209852:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+15:15106:x1876474454961536:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789545826.210007:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+15:15106:x1876474454961536:12345-0@lo:502:mount.lustre.0 Request processed in 156us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545826.210015:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789545826.210101:0:15106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454961536:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789545826.210183:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789545826.210192:0:15106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1789545826.211902:0:15124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789545826.211917:0:15124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789545826.211919:0:15124:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789545826.211927:0:15124:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff994becda0000 00000020:00000080:1.0:1789545826.211930:0:15124:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789545826.211938:0:15124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789545826.211940:0:15124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789545826.211941:0:15124:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789545826.211943:0:15124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789545826.211945:0:15124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789545826.211947:0:15124:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789545826.211949:0:15124:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff994becda0000 00000020:00000080:1.0:1789545826.211951:0:15124:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789545826.212097:0:15124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789545826.212102:0:15124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789545826.212103:0:15124:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789545826.212106:0:15124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789545826.212108:0:15124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789545826.212109:0:15124:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789545826.212112:0:15124:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff994becda0000 00000020:00000080:1.0:1789545826.212114:0:15124:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789545826.213171:0:15124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789545826.213179:0:15124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789545826.213181:0:15124:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789545826.213187:0:15124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1789545826.224851:0:15106:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789545826.224899:0:15106:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789545826.224924:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bee11be00/0x64919c0f856c174f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1756 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545826.224937:0:15106:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bee11be00/0x64919c0f856c174f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1756 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789545826.224988:0:15106:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789545826.224991:0:15106:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff994becda0000 10000000:01000000:2.0:1789545826.224995:0:15106:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff994becda0000 10000000:01000000:2.0:1789545826.224999:0:15106:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789545826.225005:0:15106:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff994becda0000 from 1 10000000:01000000:2.0:1789545826.225007:0:15106:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789545826.225045:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d1a00/0x64919c0f856c175d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545826.225054:0:15106:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc49d1a00/0x64919c0f856c175d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545826.225066:0:15106:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc49d1a00/0x64919c0f856c175d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545826.225104:0:15106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454961664:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789545826.225172:0:15106:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545826.225209:0:15106:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfc40e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789545826.226471:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454961664 00000100:00100000:2.0:1789545826.226481:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454961664 00000100:00100000:2.0:1789545826.226530:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789545826.226540:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+15:15106:x1876474454961664:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789545826.226554:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545826.226582:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc49d0c00/0x64919c0f856c1764 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c175d expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545826.226610:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc49d0c00/0x64919c0f856c1764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c175d expref: 16 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545826.226622:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc49d0c00/0x64919c0f856c1764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c175d expref: 16 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545826.226633:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0c00, rc 0) 00000100:00100000:2.0:1789545826.226700:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+16:15106:x1876474454961664:12345-0@lo:101:mount.lustre.0 Request processed in 161us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545826.226707:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789545826.232031:0:15106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454961664:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789545826.232064:0:15106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc49d1a00/0x64919c0f856c175d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1764 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545826.232078:0:15106:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc49d1a00/0x64919c0f856c175d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c1764 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789545826.232759:0:15106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1789545826.233063:0:15106:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789545826.233293:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789545826.233331:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789545826.233394:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789545826.233443:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789545826.233481:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789545826.233531:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789545826.233582:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789545826.233619:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789545826.233663:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789545826.233697:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789545826.233733:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789545826.233783:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789545826.233835:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789545826.233867:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789545826.233911:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789545826.233946:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789545826.233980:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789545826.234045:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789545826.234083:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789545826.234113:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789545826.234153:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789545826.234184:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789545826.234214:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789545826.234258:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789545826.234292:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1789545826.234320:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1789545826.234356:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1789545826.234422:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1789545826.234515:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1789545826.234530:0:15106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1789545826.234649:0:15106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454961792:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789545826.234719:0:15106:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545826.234768:0:15106:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfc40e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789545826.235035:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454961792 00000100:00100000:3.0:1789545826.235042:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454961792 00000100:00100000:3.0:1789545826.235093:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789545826.235103:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+16:15106:x1876474454961792:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789545826.235388:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+16:15106:x1876474454961792:12345-0@lo:501:mount.lustre.0 Request processed in 286us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545826.235396:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789545826.236535:0:15106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454961792:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789545826.236609:0:15106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454961920:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789545826.236670:0:15106:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545826.237525:0:15106:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfc40e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789545826.238513:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454961920 00000100:00100000:3.0:1789545826.238525:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454961920 00000100:00100000:3.0:1789545826.238623:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789545826.238635:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf541450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+16:15106:x1876474454961920:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789545826.238866:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf541450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+16:15106:x1876474454961920:12345-0@lo:503:mount.lustre.0 Request processed in 232us (2195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545826.238873:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789545826.242384:0:15106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454961920:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789545826.243000:0:15106:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789545826.243084:0:15106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454962048:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789545826.243161:0:15106:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545826.243215:0:15106:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc4e3d180 going to sleep for 11 seconds 00000100:00100000:3.0:1789545826.243385:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454962048 00000100:00100000:3.0:1789545826.243392:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454962048 00000100:00100000:3.0:1789545826.243458:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789545826.243468:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+16:15106:x1876474454962048:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789545826.243697:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+16:15106:x1876474454962048:12345-0@lo:502:mount.lustre.0 Request processed in 230us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545826.243706:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789545826.244539:0:15106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454962048:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789545826.244818:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789545826.244873:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789545826.244912:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789545826.244959:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789545826.244995:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789545826.245065:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789545826.245103:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789545826.245135:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789545826.245182:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789545826.245220:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789545826.245256:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789545826.248553:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789545826.248638:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789545826.248684:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789545826.248730:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789545826.248766:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789545826.248799:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789545826.248847:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789545826.248881:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789545826.248912:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789545826.248955:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789545826.248988:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789545826.249017:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789545826.249066:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789545826.249100:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1789545826.249132:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1789545826.249181:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1789545826.249218:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1789545826.251505:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1789545826.251663:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1789545826.251706:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1789545826.251741:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1789545826.251777:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1789545826.251828:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1789545826.251868:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1789545826.251919:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1789545826.251980:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1789545826.252015:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1789545826.252066:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1789545826.252101:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1789545826.252151:0:15106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454962176:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789545826.252226:0:15106:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545826.252409:0:15106:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfc796c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789545826.253968:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454962176 00000100:00100000:2.0:1789545826.253980:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454962176 00000100:00100000:0.0:1789545826.254134:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789545826.254145:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf543c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+16:15106:x1876474454962176:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789545826.254549:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf543c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+16:15106:x1876474454962176:12345-0@lo:502:mount.lustre.0 Request processed in 404us (2321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545826.254568:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789545826.254683:0:15106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454962176:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789545826.254791:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1789545826.254807:0:15106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1789545826.255974:0:15129:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789545826.255991:0:15129:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff994be6e399c0) 00000020:00000080:2.0:1789545826.256011:0:15129:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1789545826.256093:0:15129:0:(tgt_mount.c:153:server_get_mount()) get mount ffff994becda0000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789545826.256098:0:15129:0:(tgt_mount.c:187:server_put_mount()) put mount ffff994becda0000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789545826.256100:0:15129:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994becda0000 3 00010000:00080000:2.0:1789545826.256130:0:15129:0:(ldlm_lib.c:102:import_set_conn()) imp ffff994bc4be9000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.116@tcp at head 00010000:00010000:2.0:1789545826.258096:0:15129:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1789545826.258419:0:15129:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789545826.258456:0:15129:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789545826.258469:0:15129:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x64919c0f856c1772 00000100:00080000:2.0:1789545826.258479:0:15129:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789545826.258491:0:15129:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff994bc4be9000 using connection 192.168.201.116@tcp/0@lo 00000100:00100000:2.0:1789545826.258528:0:15129:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994be4edca80 x1876474454962304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789545826.258566:0:15129:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789545826.258810:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1876474454962304:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789545826.258885:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545826.258996:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454962304 00000100:00100000:2.0:1789545826.259004:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454962304 00000100:00100000:2.0:1789545826.259036:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789545826.259042:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1876474454962304:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789545826.259066:0:14423:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:2.0:1789545826.259103:0:14423:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x64919c0f856c1779 00000004:00100000:2.0:1789545826.259119:0:14423:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789545826.259149:0:14423:0:(import.c:65:import_set_state_nolock()) ffff994be47a4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789545826.259212:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876474454962304:12345-0@lo:38:llog_process_th.0 Request processed in 169us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545826.259220:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789545826.259306:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789545826.259311:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789545826.259314:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789545826.259316:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789545826.259383:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789545826.259393:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be479b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454962432:0@lo:400:kworker.0 00000100:00100000:0.0:1789545826.259422:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545826.259451:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454962432 00000100:00100000:0.0:1789545826.259455:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454962432 00000100:00100000:0.0:1789545826.259484:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789545826.259491:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be479aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454962432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545826.259526:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be479aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454962432:12345-0@lo:400:kworker.0 Request processed in 36us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545826.259533:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789545826.259572:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff994be479b800 x1876474454962432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545826.259586:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be479b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454962432:0@lo:400:kworker.0 00010000:00080000:3.0:1789545826.259752:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff994be4edca80 x1876474454962304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789545836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545826.259759:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789545826.259765:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789545826.259772:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789545826.259777:0:3310:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789545826.259786:0:3310:0:(import.c:65:import_set_state_nolock()) ffff994bc4be9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789545826.259792:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1876474454962304:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1789545826.259991:0:15129:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1789545826.262650:0:15106:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789545826.262700:0:15106:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789545826.262726:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d1a00/0x64919c0f856c175d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1764 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545826.262738:0:15106:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc49d1a00/0x64919c0f856c175d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1764 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789545826.262807:0:15106:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789545826.262809:0:15106:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789545826.262811:0:15106:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789545826.262812:0:15106:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789545826.262813:0:15106:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789545826.262815:0:15106:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789545826.262816:0:15106:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789545826.262818:0:15106:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789545826.262819:0:15106:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789545826.262822:0:15106:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1789545826.262825:0:15106:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789545826.262826:0:15106:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789545826.262827:0:15106:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789545826.262828:0:15106:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789545826.262829:0:15106:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789545826.262831:0:15106:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789545826.262832:0:15106:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789545826.262833:0:15106:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789545826.262834:0:15106:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789545826.262859:0:15106:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789545826.262879:0:15106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454962560:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789545826.262945:0:15106:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545826.262983:0:15106:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8e38d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789545826.263042:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454962560 00000100:00100000:2.0:1789545826.263050:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454962560 00000100:00100000:2.0:1789545826.263099:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789545826.263108:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+16:15106:x1876474454962560:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789545826.263132:0:14416:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789545826.263146:0:14416:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789545826.295820:0:14416:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789545826.295842:0:14416:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789545826.295908:0:14439:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789545826.295913:0:14439:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789545826.295936:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff994be4eb6200/0x64919c0f856c1780 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545826.295957:0:14439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bee11a000/0x64919c0f856c16ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c16e6 expref: 16 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545826.295967:0:14439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff994be4eb6200/0x64919c0f856c1780 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545826.296029:0:14439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bee11a000/0x64919c0f856c16ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c16e6 expref: 16 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545826.296042:0:14439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994bee11a000/0x64919c0f856c16ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c16e6 expref: 16 pid: 14416 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545826.296058:0:14439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be479b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14439:1876474454962688:0@lo:104: 00000100:00100000:0.0:1789545826.296130:0:14439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545826.296190:0:14439:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc12ed780 going to sleep for 11 seconds 00000100:00100000:2.0:1789545826.296455:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454962688 00000100:00100000:2.0:1789545826.296464:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454962688 00000100:00100000:2.0:1789545826.296518:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789545826.296528:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be479a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6de5819a-62ff-4f85-af03-c287b54b27c1+3:14439:x1876474454962688:12345-0@lo:104: 00010000:00010000:2.0:1789545826.296541:0:14407:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c16e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c16ed expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545826.296614:0:14407:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789545826.296620:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be479a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6de5819a-62ff-4f85-af03-c287b54b27c1+3:14439:x1876474454962688:12345-0@lo:104: Request processed in 95us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545826.296627:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789545826.296648:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789545826.296654:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c16e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c16ed expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545826.296662:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6c00 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:2.0:1789545826.296666:0:14411:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c16e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c16ed expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545826.296675:0:14411:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c16e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c16ed expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789545826.296682:0:14411:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c16e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c16ed expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789545826.296688:0:14411:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789545826.296718:0:14411:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c16e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c16ed expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545826.296725:0:14411:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789545826.296745:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c16e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c16ed expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545826.296752:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c16e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c16ed expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545826.296780:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545826.296782:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545826.296784:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545826.296804:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789545826.296815:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6de5819a-62ff-4f85-af03-c287b54b27c1:3314:1876474454962816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789545826.296848:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545826.296938:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454962816 00000100:00100000:1.0:1789545826.296943:0:14458:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454962816 00010000:00010000:1.0:1789545826.296963:0:14458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bee11a000/0x64919c0f856c16ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c16e6 expref: 17 pid: 14416 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545826.296997:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789545826.297004:0:14458:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6de5819a-62ff-4f85-af03-c287b54b27c1+17:3314:x1876474454962816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789545826.297015:0:14458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545826.297027:0:14458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bee11a000/0x64919c0f856c16ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c16e6 expref: 17 pid: 14416 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545826.297038:0:14458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bee11a000/0x64919c0f856c16ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c16e6 expref: 17 pid: 14416 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545826.297057:0:14458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff994be4eb6200/0x64919c0f856c1780 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545826.297065:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994be4eb6200/0x64919c0f856c1780 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789545826.297078:0:14458:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001300560s 00010000:00010000:1.0:1789545826.297082:0:14458:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994be4eb6200/0x64919c0f856c1780 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545826.297090:0:14458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994be4eb6200/0x64919c0f856c1780 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545826.297098:0:14458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff994be4eb6200/0x64919c0f856c1780 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545826.297104:0:14458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff994be4eb6200/0x64919c0f856c1780 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545826.297109:0:14458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6200 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:1.0:1789545826.297113:0:14458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff994be4eb6200/0x64919c0f856c1780 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545826.297120:0:14458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff994be4eb6200/0x64919c0f856c1780 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545826.297128:0:14458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff994be4eb6200/0x64919c0f856c1780 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545826.297155:0:14458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789545826.297190:0:14458:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6de5819a-62ff-4f85-af03-c287b54b27c1+17:3314:x1876474454962816:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545826.297197:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789545826.297233:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6de5819a-62ff-4f85-af03-c287b54b27c1:3314:1876474454962816:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789545826.297474:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bee11a000/0x64919c0f856c16ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c16e6 expref: 16 pid: 14416 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545826.297486:0:14439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be479b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14439:1876474454962688:0@lo:104: 00010000:00010000:0.0:1789545826.297502:0:14439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff994be4eb6200/0x64919c0f856c1780 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545826.297510:0:14439:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff994be4eb6200/0x64919c0f856c1780 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545826.297516:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff994be4eb6200/0x64919c0f856c1780 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545826.297523:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994be4eb6200/0x64919c0f856c1780 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545826.309327:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+15:15106:x1876474454962560:12345-0@lo:253:mount.lustre.0 Request processed in 46147us (46309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545826.309344:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789545826.310626:0:15106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15106:1876474454962560:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789545826.310663:0:15106:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789545826.310667:0:15106:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789545826.310668:0:15106:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789545826.310670:0:15106:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789545826.310671:0:15106:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789545826.310672:0:15106:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789545826.310673:0:15106:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789545826.310675:0:15106:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789545826.310676:0:15106:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789545826.310678:0:15106:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789545826.310696:0:15106:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789545826.315065:0:15106:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789545826.315527:0:15106:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789545826.315698:0:15106:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789545826.315848:0:15106:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789545826.316000:0:15106:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789545826.316810:0:15106:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789545826.317757:0:15106:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789545826.428013:0:15106:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789545826.428022:0:15106:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789545826.428059:0:15106:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789545826.428114:0:15106:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.116@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789545826.428134:0:15106:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789545826.428435:0:15106:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1789545826.876475:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789545827.711790:0:14420:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789545827.711800:0:14420:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff994bdfb81000 from 7 10000000:01000000:0.0:1789545827.711805:0:14420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789545827.711856:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c1787 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545827.711868:0:14420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c1787 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545827.711879:0:14420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c1787 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545827.711908:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be479b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454962944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789545827.712107:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545827.712164:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdf465c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789545827.712227:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454962944 00000100:00100000:1.0:1789545827.712246:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454962944 00000100:00100000:1.0:1789545827.712307:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789545827.712316:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+15:14420:x1876474454962944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789545827.712330:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545827.712344:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc8ba9a00/0x64919c0f856c178e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c1787 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545827.712385:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc8ba9a00/0x64919c0f856c178e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c1787 expref: 16 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545827.712397:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc8ba9a00/0x64919c0f856c178e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c1787 expref: 16 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545827.712407:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba9a00, rc 0) 00000100:00100000:1.0:1789545827.712463:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+16:14420:x1876474454962944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545827.712470:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789545827.712597:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be479b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454962944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789545827.712613:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c1787 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c178e expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545827.712623:0:14420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c1787 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c178e expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545827.712686:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454963072:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789545827.712844:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545827.712945:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bf56e7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789545827.712996:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454963072 00000100:00100000:3.0:1789545827.713001:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454963072 00000100:00100000:3.0:1789545827.713042:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789545827.713050:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+16:14420:x1876474454963072:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789545827.713066:0:14416:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789545827.713085:0:14416:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789545827.713088:0:14416:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1789545827.713187:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+16:14420:x1876474454963072:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 137us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545827.713195:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789545827.713233:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454963072:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789545827.713293:0:14420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789545827.713300:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c1787 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c178e expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545827.713320:0:14420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c1787 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c178e expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545827.900697:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545828.925601:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545829.948708:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545830.972555:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789545831.492864:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789545831.492872:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789545831.492887:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789545831.492890:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789545831.492994:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789545831.493018:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6de5819a-62ff-4f85-af03-c287b54b27c1:3313:1876474454963200:0@lo:400:kworker.0 00000100:00100000:2.0:1789545831.493046:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876474454963456:0@lo:400:kworker.0 00000100:00100000:0.0:1789545831.493111:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545831.502746:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545831.502839:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789545831.502851:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876474454963328:0@lo:400:kworker.0 00000100:00100000:2.0:1789545831.503563:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545831.504154:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454963200 00000100:00100000:0.0:1789545831.504166:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454963200 00000100:00100000:0.0:1789545831.504240:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789545831.504250:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be41eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+16:3313:x1876474454963200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545831.504318:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be41eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+16:3313:x1876474454963200:12345-0@lo:400:kworker.0 Request processed in 70us (11213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545831.504325:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789545831.504381:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454963456 00000100:00100000:0.0:1789545831.504397:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454963456 00000100:00100000:0.0:1789545831.504441:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454963328 00000100:00100000:0.0:1789545831.504445:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454963328 00000100:00100000:0.0:1789545831.504459:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789545831.504475:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876474454963456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545831.504518:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876474454963456:12345-0@lo:400:kworker.0 Request processed in 54us (1782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545831.504525:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789545831.504536:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789545831.504542:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876474454963328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545831.504583:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876474454963328:12345-0@lo:400:kworker.0 Request processed in 42us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545831.504589:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789545831.504943:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6de5819a-62ff-4f85-af03-c287b54b27c1:3313:1876474454963200:0@lo:400:kworker.0 00010000:00080000:2.0:1789545831.505487:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994be4edf100 x1876474454963328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545831.505500:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876474454963328:0@lo:400:kworker.0 00010000:00080000:2.0:1789545831.505512:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994be4edea00 x1876474454963456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545831.505520:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876474454963456:0@lo:400:kworker.0 00000100:00080000:1.0:1789545831.506762:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789545831.996565:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789545832.240942:0:15473:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg116-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789545833.034655:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545834.046881:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545835.071123:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789545835.646321:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789545836.092973:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789545836.605582:0:12196:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789545836.605591:0:12196:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789545836.605593:0:12196:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789545836.605597:0:12196:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789545836.605624:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6de5819a-62ff-4f85-af03-c287b54b27c1:3313:1876474454963584:0@lo:400:kworker.0 00000100:00100000:3.0:1789545836.605635:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876474454963712:0@lo:400:kworker.0 00000100:00100000:2.0:1789545836.605728:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789545836.605743:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876474454963840:0@lo:400:kworker.0 00000100:00100000:3.0:1789545836.605800:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545836.606221:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454963712 00000100:00100000:0.0:1789545836.606231:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454963712 00000100:00100000:0.0:1789545836.606295:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789545836.606306:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876474454963712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545836.606401:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876474454963712:12345-0@lo:400:kworker.0 Request processed in 98us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545836.606409:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789545836.606721:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994be4b3ca80 x1876474454963712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545836.606738:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876474454963712:0@lo:400:kworker.0 00000100:00100000:1.0:1789545836.610886:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545836.611650:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454963584 00000100:00100000:3.0:1789545836.611663:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454963584 00000100:00100000:3.0:1789545836.611720:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789545836.611730:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be41ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+16:3313:x1876474454963584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545836.611807:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be41ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+16:3313:x1876474454963584:12345-0@lo:400:kworker.0 Request processed in 79us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545836.611814:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789545836.612873:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6de5819a-62ff-4f85-af03-c287b54b27c1:3313:1876474454963584:0@lo:400:kworker.0 00000100:00100000:2.0:1789545836.619852:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545836.619950:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454963840 00000100:00100000:2.0:1789545836.619959:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454963840 00000100:00100000:2.0:1789545836.620030:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789545836.620041:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876474454963840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545836.620107:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876474454963840:12345-0@lo:400:kworker.0 Request processed in 69us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545836.620130:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789545836.620435:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994be4b3c700 x1876474454963840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545836.620463:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876474454963840:0@lo:400:kworker.0 00000100:00080000:1.0:1789545836.620759:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789545837.120069:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545838.140919:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545838.528818:0:3310:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789545823/real 1789545823] req@ffff994be4edd880 x1876474454959872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789545838 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545838.528850:0:3310:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff994be4edd880 x1876474454959872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789545838 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545838.528861:0:3310:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789545823/real 1789545823] req@ffff994be4b3c380 x1876474454959744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789545838 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545838.528872:0:3310:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff994be4b3c380 x1876474454959744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789545838 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789545838.528890:0:3310:0:(import.c:65:import_set_state_nolock()) ffff994bc2e68000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789545838.531122:0:3310:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789545838.531132:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876474454959872:0@lo:8:kworker.0 00000100:00080000:2.0:1789545838.531154:0:3310:0:(import.c:65:import_set_state_nolock()) ffff994bc8ff8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789545838.531434:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789545838.531445:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789545838.531449:0:36:0:(import.c:65:import_set_state_nolock()) ffff994bc2e68000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789545838.531454:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 437 00000100:00080000:0.0:1789545838.531460:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789545838.531473:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff994bc2e68000 using connection 192.168.201.116@tcp/0@lo 00000100:00100000:0.0:1789545838.531495:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994be479b100 x1876474454964096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789545838.531506:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789545838.531750:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789545838.531752:0:36:0:(import.c:65:import_set_state_nolock()) ffff994bc8ff8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789545838.531756:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 437 00000100:00080000:0.0:1789545838.531759:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789545838.531765:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff994bc8ff8800 using connection 192.168.201.116@tcp/0@lo 00000100:00100000:0.0:1789545838.531779:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994be4798700 x1876474454964224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789545838.531832:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789545838.531846:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6de5819a-62ff-4f85-af03-c287b54b27c1:3311:1876474454963968:0@lo:400:kworker.0 00000100:00100000:0.0:1789545838.531906:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545838.531961:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454964352:0@lo:400:kworker.0 00000100:00100000:0.0:1789545838.531989:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545838.532011:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789545838.532017:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454964480:0@lo:400:kworker.0 00000100:00100000:0.0:1789545838.532041:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545838.532069:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454964352 00000100:00100000:0.0:1789545838.532076:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454964352 00000100:00100000:0.0:1789545838.532122:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454964480 00000100:00100000:0.0:1789545838.532125:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454964480 00000100:00100000:0.0:1789545838.532333:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789545838.532351:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be479b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454964352:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789545838.532404:0:3310:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789545838.532408:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876474454959744:0@lo:8:kworker.0 00000100:00100000:2.0:1789545838.532431:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be479b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876474454964096:0@lo:8:kworker.0 00000100:00100000:2.0:1789545838.532465:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545838.532491:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876474454964224:0@lo:8:kworker.0 00000100:00100000:2.0:1789545838.532528:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545838.532577:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454963968 00000100:00100000:2.0:1789545838.532582:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454963968 00000100:00100000:2.0:1789545838.532611:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789545838.532618:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be41ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+16:3311:x1876474454963968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545838.532669:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be41ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+16:3311:x1876474454963968:12345-0@lo:400:kworker.0 Request processed in 50us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545838.532676:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789545838.532711:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454964096 00000100:00100000:2.0:1789545838.532714:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454964096 00000100:00100000:2.0:1789545838.532729:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454964224 00000100:00100000:2.0:1789545838.532731:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454964224 00000100:00100000:2.0:1789545838.532741:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789545838.532746:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1876474454964096:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789545838.532770:0:15107:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:2.0:1789545838.532795:0:15107:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x64919c0f856c1795 00002000:00100000:2.0:1789545838.532810:0:15107:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff994be47a0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789545838.532815:0:15107:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789545838.532818:0:15107:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789545838.534003:0:15107:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789545838.534037:0:15107:0:(import.c:65:import_set_state_nolock()) ffff994be47a1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789545838.534115:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1876474454964096:12345-0@lo:8:kworker.0 Request processed in 1365us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545838.534124:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789545838.534161:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789545838.534167:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1876474454964224:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789545838.534429:0:15107:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789545838.534462:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1876474454964224:12345-0@lo:8:kworker.0 Request processed in 295us (1934us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789545838.534478:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789545838.534529:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6de5819a-62ff-4f85-af03-c287b54b27c1:3311:1876474454963968:0@lo:400:kworker.0 00010000:00080000:2.0:1789545838.534569:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994be479b100 x1876474454964096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789545858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545838.534579:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789545838.534586:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789545838.534595:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789545838.534599:0:3310:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789545838.534602:0:3310:0:(import.c:65:import_set_state_nolock()) ffff994bc2e68000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789545838.534618:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789545838.534623:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be479b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876474454964096:0@lo:8:kworker.0 00000100:00080000:2.0:1789545838.534634:0:3310:0:(import.c:65:import_set_state_nolock()) ffff994bc8ff8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789545838.534637:0:3310:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789545838.534640:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876474454964224:0@lo:8:kworker.0 00000004:00080000:2.0:1789545838.534697:0:14446:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1789545838.534716:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14446:1876474454964736:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789545838.534749:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545838.534770:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd1732b40 going to sleep for 11 seconds 00000004:00080000:2.0:1789545838.534784:0:14445:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789545838.535053:0:14445:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 452457692414ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789545838.535073:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789545838.535082:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454964608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789545838.535109:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545838.538665:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454964736 00000100:00100000:2.0:1789545838.538682:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454964736 00000100:00100000:2.0:1789545838.538744:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789545838.538754:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14446:x1876474454964736:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789545838.540131:0:14424:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789545838.540143:0:14424:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789545838.540161:0:14425:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789545838.540174:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789545838.540188:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454964480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545838.540289:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454964480:12345-0@lo:400:kworker.0 Request processed in 105us (8246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545838.540296:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789545838.540393:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994be4799500 x1876474454964480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545838.540409:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454964480:0@lo:400:kworker.0 00000100:00080000:0.0:1789545838.540437:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789545838.540442:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789545838.540499:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be479b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454964352:12345-0@lo:400:kworker.0 Request processed in 8148us (8508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545838.540507:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789545838.540533:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994be4798a80 x1876474454964352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545838.540542:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454964352:0@lo:400:kworker.0 00000100:00100000:3.0:1789545838.543539:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454964608 00000100:00100000:3.0:1789545838.543556:0:15111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454964608 00000100:00100000:3.0:1789545838.544446:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789545838.544460:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1876474454964608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789545838.544500:0:15111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789545838.544587:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1876474454964608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (9477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545838.544604:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00002000:00080000:2.0:1789545838.548515:0:15109:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1789545838.548528:0:15109:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1789545838.548533:0:15109:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00010000:00080000:3.0:1789545838.552887:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994be4ede300 x1876474454964608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789545838.553192:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454964608:0@lo:13:osp-pre-0-0.0 00002000:00010000:2.0:1789545838.557278:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545838.557293:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031b6c5ca/0x64919c0f856c179c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.557311:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1789545838.557315:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545838.557322:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031b6c5ca/0x64919c0f856c179c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.557352:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031b6c5ca/0x64919c0f856c179c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.557381:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031b6c5ca/0x64919c0f856c179c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.557389:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031b6c5ca/0x64919c0f856c179c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.557411:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789545838.557904:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545838.557911:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c17a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545838.557994:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789545838.558001:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031b6c5ca/0x64919c0f856c179c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545838.558010:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0000 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545838.558015:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031b6c5ca/0x64919c0f856c179c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545838.558024:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031b6c5ca/0x64919c0f856c179c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545838.558044:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031b6c5ca/0x64919c0f856c179c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545838.558051:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031b6c5ca/0x64919c0f856c179c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545838.558068:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545838.558069:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545838.558071:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545838.558715:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1789545838.558720:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545838.558725:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c17a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.558736:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c17a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.558746:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c17a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.558754:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c17a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.558769:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789545838.558780:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789545838.558784:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c17a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.558792:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1c00 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:2.0:1789545838.558795:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c17a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.558803:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c17a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.558825:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c17a3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.558832:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c17a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.558846:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545838.558848:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545838.558849:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545838.560051:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545838.560061:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048b2a4d9/0x64919c0f856c17aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.560071:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1789545838.560075:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545838.560080:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048b2a4d9/0x64919c0f856c17aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.560091:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048b2a4d9/0x64919c0f856c17aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.560100:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048b2a4d9/0x64919c0f856c17aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.560107:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048b2a4d9/0x64919c0f856c17aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.560135:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789545838.560552:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545838.560558:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c17b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.560567:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1789545838.560570:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545838.560573:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c17b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.560582:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c17b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.560590:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c17b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.560597:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c17b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.560610:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789545838.560620:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789545838.560624:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048b2a4d9/0x64919c0f856c17aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.560632:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0400 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:2.0:1789545838.560643:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048b2a4d9/0x64919c0f856c17aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.560652:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048b2a4d9/0x64919c0f856c17aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.560667:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048b2a4d9/0x64919c0f856c17aa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.560674:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048b2a4d9/0x64919c0f856c17aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.560689:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789545838.560692:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c17b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.560699:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1200 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:2.0:1789545838.560702:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c17b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.560709:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c17b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.560718:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c17b1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.560725:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c17b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.560744:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545838.560745:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545838.560747:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545838.560777:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545838.561669:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545838.561677:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c17b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.561688:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1789545838.561691:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545838.561695:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c17b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.561706:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c17b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.561714:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c17b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.561722:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c17b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.561740:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789545838.561979:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789545838.561991:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c17b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545838.561999:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0200 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545838.562002:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c17b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545838.562010:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c17b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545838.562024:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c17b8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545838.562030:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c17b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545838.562045:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545838.562046:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545838.562048:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545838.563580:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545838.563591:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3ec73e6/0x64919c0f856c17bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.563615:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1789545838.563619:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545838.563624:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3ec73e6/0x64919c0f856c17bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.563637:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3ec73e6/0x64919c0f856c17bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.563647:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3ec73e6/0x64919c0f856c17bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.563654:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3ec73e6/0x64919c0f856c17bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.563670:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789545838.563682:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789545838.563687:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3ec73e6/0x64919c0f856c17bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.563694:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0a00 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:2.0:1789545838.563698:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3ec73e6/0x64919c0f856c17bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.563706:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3ec73e6/0x64919c0f856c17bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.563732:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3ec73e6/0x64919c0f856c17bf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.563739:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3ec73e6/0x64919c0f856c17bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.563754:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545838.563756:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545838.563758:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545838.567056:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545838.567071:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c17c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.567088:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1789545838.567094:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545838.567101:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c17c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.567115:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c17c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.567127:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c17c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.567136:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c17c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.567170:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789545838.567667:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545838.567673:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c17cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.567682:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1789545838.567685:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545838.567689:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c17cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.567698:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c17cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.567706:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c17cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.567714:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c17cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.567730:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789545838.567741:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789545838.567747:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c17c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.567755:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1e00 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:2.0:1789545838.567765:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c17c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.567775:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c17c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.567791:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c17c6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.567799:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c17c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.567812:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789545838.567815:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c17cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.567822:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1200 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:2.0:1789545838.567825:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c17cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.567832:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c17cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.567841:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c17cd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.567849:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c17cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.567864:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545838.567866:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545838.567868:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545838.568278:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545838.568284:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048b2a4d9/0x64919c0f856c17d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.568292:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1789545838.568296:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545838.568300:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048b2a4d9/0x64919c0f856c17d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.568309:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048b2a4d9/0x64919c0f856c17d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.568317:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048b2a4d9/0x64919c0f856c17d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.568324:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048b2a4d9/0x64919c0f856c17d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.570979:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789545838.571691:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789545838.571701:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048b2a4d9/0x64919c0f856c17d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545838.571715:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0400 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545838.571720:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048b2a4d9/0x64919c0f856c17d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545838.571741:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048b2a4d9/0x64919c0f856c17d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545838.571763:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048b2a4d9/0x64919c0f856c17d4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545838.571770:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048b2a4d9/0x64919c0f856c17d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545838.571793:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545838.571795:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545838.571796:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545838.572264:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545838.572421:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545838.572429:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3ec73e6/0x64919c0f856c17db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.572453:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1789545838.572457:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545838.572464:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3ec73e6/0x64919c0f856c17db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.572477:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3ec73e6/0x64919c0f856c17db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.572840:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3ec73e6/0x64919c0f856c17db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.572854:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3ec73e6/0x64919c0f856c17db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.572880:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789545838.573069:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789545838.573075:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3ec73e6/0x64919c0f856c17db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545838.573083:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0a00 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545838.573086:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3ec73e6/0x64919c0f856c17db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545838.573094:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3ec73e6/0x64919c0f856c17db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545838.573118:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3ec73e6/0x64919c0f856c17db lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545838.573138:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3ec73e6/0x64919c0f856c17db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545838.573157:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545838.573159:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545838.573161:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545838.575027:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545838.575037:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c17e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.575053:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1789545838.575058:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545838.575063:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c17e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.575076:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c17e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.575096:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c17e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.575104:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c17e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.575127:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789545838.575709:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789545838.575716:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c17e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.575725:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1c00 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:2.0:1789545838.575730:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c17e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.575739:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c17e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.575756:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c17e2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.575763:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c17e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.575782:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545838.575790:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545838.575792:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545838.578968:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545838.578981:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c17e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.578997:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1789545838.579002:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545838.579008:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c17e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.579021:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c17e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.579032:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c17e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.579040:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c17e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.579555:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789545838.583058:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545838.583072:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c17f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.583088:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1789545838.583093:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545838.583099:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c17f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.583121:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c17f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.583131:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c17f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545838.583183:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789545838.583191:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c17e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545838.583200:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1200 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:0.0:1789545838.583205:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c17e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545838.583215:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c17e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545838.583245:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c17e9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545838.583253:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c17e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545838.583271:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545838.583273:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545838.583275:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545838.583643:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c17f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.583661:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789545838.583673:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789545838.583677:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c17f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.583684:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1e00 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:2.0:1789545838.583688:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c17f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.583696:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c17f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.583707:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c17f0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.583714:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c17f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.583733:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545838.583734:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545838.583736:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545838.584497:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545838.584505:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da4a1aaa/0x64919c0f856c17f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.584515:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1789545838.584519:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545838.584525:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da4a1aaa/0x64919c0f856c17f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.584536:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da4a1aaa/0x64919c0f856c17f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.584545:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da4a1aaa/0x64919c0f856c17f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.584552:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da4a1aaa/0x64919c0f856c17f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.584576:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789545838.584988:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789545838.584995:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da4a1aaa/0x64919c0f856c17f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545838.585003:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1800 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:1.0:1789545838.585006:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da4a1aaa/0x64919c0f856c17f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545838.585013:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da4a1aaa/0x64919c0f856c17f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545838.585028:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da4a1aaa/0x64919c0f856c17f7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545838.585045:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da4a1aaa/0x64919c0f856c17f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545838.585064:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545838.585066:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545838.585068:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545838.585426:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545838.585432:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c118d3c/0x64919c0f856c17fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.585451:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1789545838.585455:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545838.585460:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c118d3c/0x64919c0f856c17fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.585469:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c118d3c/0x64919c0f856c17fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.585479:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c118d3c/0x64919c0f856c17fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.585488:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c118d3c/0x64919c0f856c17fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.585503:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789545838.585511:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789545838.585516:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c118d3c/0x64919c0f856c17fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.585523:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1600 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:2.0:1789545838.585527:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c118d3c/0x64919c0f856c17fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.585534:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c118d3c/0x64919c0f856c17fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.585555:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c118d3c/0x64919c0f856c17fe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.585562:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c118d3c/0x64919c0f856c17fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.585577:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545838.585579:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545838.585581:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545838.586825:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545838.586837:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c1805 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.586850:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1789545838.586854:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545838.586860:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c1805 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.586872:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c1805 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.586881:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c1805 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.586889:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c1805 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.593119:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789545838.593815:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545838.593825:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c180c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.593842:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1789545838.593847:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545838.593853:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c180c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.593866:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c180c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.593876:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c180c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.593883:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c180c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.593900:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789545838.593912:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789545838.593918:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c1805 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.593926:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0200 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:2.0:1789545838.593938:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c1805 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.593947:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c1805 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.593965:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c1805 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.593973:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c1805 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.593991:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789545838.593994:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c180c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.594000:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1c00 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:2.0:1789545838.594004:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c180c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.594010:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c180c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.594019:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c180c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.594026:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c180c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.595041:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545838.595834:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545838.595838:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545838.597780:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545838.597793:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031b6c5ca/0x64919c0f856c1813 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.597808:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1789545838.597812:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545838.597819:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031b6c5ca/0x64919c0f856c1813 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.597832:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031b6c5ca/0x64919c0f856c1813 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.597843:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031b6c5ca/0x64919c0f856c1813 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.597851:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031b6c5ca/0x64919c0f856c1813 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.597872:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789545838.597885:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789545838.597890:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031b6c5ca/0x64919c0f856c1813 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.597908:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0000 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:2.0:1789545838.597913:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031b6c5ca/0x64919c0f856c1813 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.599012:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031b6c5ca/0x64919c0f856c1813 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.599033:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031b6c5ca/0x64919c0f856c1813 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.599040:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031b6c5ca/0x64919c0f856c1813 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.603093:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545838.603101:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545838.603104:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545838.605236:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545838.605680:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545838.605691:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c118d3c/0x64919c0f856c181a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.605708:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1789545838.605713:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545838.605720:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c118d3c/0x64919c0f856c181a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.605735:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c118d3c/0x64919c0f856c181a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.605755:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c118d3c/0x64919c0f856c181a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.605763:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c118d3c/0x64919c0f856c181a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.605780:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789545838.605792:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789545838.605798:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c118d3c/0x64919c0f856c181a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.605806:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1600 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:2.0:1789545838.605810:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c118d3c/0x64919c0f856c181a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.605820:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c118d3c/0x64919c0f856c181a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.605839:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c118d3c/0x64919c0f856c181a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.605847:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c118d3c/0x64919c0f856c181a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.605862:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545838.605870:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545838.605872:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545838.607098:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545838.607109:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c1821 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.607122:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1789545838.607127:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545838.607132:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c1821 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.607274:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c1821 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.607286:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c1821 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.607293:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c1821 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.607415:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789545838.607945:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545838.607952:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da4a1aaa/0x64919c0f856c1828 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.607962:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1789545838.607966:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545838.607970:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da4a1aaa/0x64919c0f856c1828 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.607987:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da4a1aaa/0x64919c0f856c1828 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.607997:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da4a1aaa/0x64919c0f856c1828 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.608004:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da4a1aaa/0x64919c0f856c1828 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545838.609589:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789545838.609604:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c1821 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545838.609616:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1e00 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:1.0:1789545838.609622:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c1821 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545838.609633:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c1821 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545838.609656:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c1821 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545838.609664:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7071d9c/0x64919c0f856c1821 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545838.609686:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789545838.609689:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da4a1aaa/0x64919c0f856c1828 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545838.609707:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1800 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:1.0:1789545838.609710:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da4a1aaa/0x64919c0f856c1828 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545838.609717:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da4a1aaa/0x64919c0f856c1828 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545838.609728:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da4a1aaa/0x64919c0f856c1828 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545838.609735:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545838.609737:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545838.609739:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545838.610298:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789545838.610306:0:15109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da4a1aaa/0x64919c0f856c1828 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.610348:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545838.614574:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545838.614587:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031b6c5ca/0x64919c0f856c182f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.614603:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1789545838.614620:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545838.614626:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031b6c5ca/0x64919c0f856c182f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.614641:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031b6c5ca/0x64919c0f856c182f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.614664:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031b6c5ca/0x64919c0f856c182f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.614672:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031b6c5ca/0x64919c0f856c182f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.614693:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789545838.615771:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545838.615781:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c1836 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.615793:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1789545838.615797:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545838.615802:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c1836 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.615814:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c1836 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.615822:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c1836 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.615830:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c1836 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.615859:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789545838.615870:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789545838.615875:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031b6c5ca/0x64919c0f856c182f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.615882:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0000 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:2.0:1789545838.615887:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031b6c5ca/0x64919c0f856c182f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.615895:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031b6c5ca/0x64919c0f856c182f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.615912:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031b6c5ca/0x64919c0f856c182f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.615919:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031b6c5ca/0x64919c0f856c182f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.615936:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789545838.615939:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c1836 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.615944:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1c00 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:2.0:1789545838.615947:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c1836 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.615963:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c1836 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.615973:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c1836 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.615979:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000392cd61/0x64919c0f856c1836 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.615990:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545838.615992:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545838.615994:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545838.616417:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545838.616424:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c183d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.616433:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1789545838.616437:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545838.616441:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c183d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.616450:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c183d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.616457:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c183d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.616473:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c183d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.616485:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789545838.616494:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789545838.616497:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c183d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.616504:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0200 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:2.0:1789545838.616507:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c183d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.616515:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c183d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.616526:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c183d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.616532:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005927aa7d/0x64919c0f856c183d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.616545:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545838.616547:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545838.616548:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545838.616938:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545838.616950:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c1844 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.616960:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1789545838.616964:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545838.616968:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c1844 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.616978:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c1844 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.616986:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c1844 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.616993:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c1844 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.617005:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789545838.617013:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789545838.617017:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c1844 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.617023:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1200 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:2.0:1789545838.617026:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c1844 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.617033:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c1844 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.617050:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c1844 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.617057:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da245593/0x64919c0f856c1844 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.617071:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545838.617073:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545838.617075:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545838.619520:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789545838.620159:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1789545838.620320:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545838.620330:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c118d3c/0x64919c0f856c184b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.620381:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1789545838.620386:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545838.620393:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c118d3c/0x64919c0f856c184b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.620407:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c118d3c/0x64919c0f856c184b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.620417:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c118d3c/0x64919c0f856c184b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.620425:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c118d3c/0x64919c0f856c184b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.620450:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789545838.620460:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789545838.620465:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c118d3c/0x64919c0f856c184b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.620473:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1600 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:2.0:1789545838.620477:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c118d3c/0x64919c0f856c184b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.620487:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c118d3c/0x64919c0f856c184b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.620504:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c118d3c/0x64919c0f856c184b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.620511:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c118d3c/0x64919c0f856c184b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.620525:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545838.620527:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545838.620529:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545838.621248:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545838.621256:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3ec73e6/0x64919c0f856c1852 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.621266:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1789545838.621274:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545838.621280:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3ec73e6/0x64919c0f856c1852 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.621290:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3ec73e6/0x64919c0f856c1852 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.621300:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3ec73e6/0x64919c0f856c1852 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.621308:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3ec73e6/0x64919c0f856c1852 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545838.621331:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1789545838.621562:0:15109:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:2.0:1789545838.621665:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14446:x1876474454964736:12345-0@lo:5:osp-pre-0-0.0 Request processed in 82909us (86911us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545838.621674:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789545838.621732:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14446:1876474454964736:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789545838.621748:0:14446:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1789545838.621796:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14446:1876474454964864:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789545838.621828:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545838.621868:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff994be4e76e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789545838.621883:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454964864 00000100:00100000:2.0:1789545838.621889:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454964864 00010000:00010000:0.0:1789545838.622618:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789545838.622627:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3ec73e6/0x64919c0f856c1852 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545838.622639:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0a00 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:0.0:1789545838.622643:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3ec73e6/0x64919c0f856c1852 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545838.622652:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3ec73e6/0x64919c0f856c1852 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545838.622672:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3ec73e6/0x64919c0f856c1852 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545838.622680:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3ec73e6/0x64919c0f856c1852 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545838.622711:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545838.622713:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545838.622715:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545838.622890:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789545838.622910:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14446:x1876474454964864:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789545838.622969:0:15107:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1789545838.635289:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14446:x1876474454964864:12345-0@lo:5:osp-pre-0-0.0 Request processed in 12382us (13451us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789545838.635303:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789545838.635431:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14446:1876474454964864:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789545838.635448:0:14446:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1789545839.175142:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789545839.615818:0:15825:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789545839.615823:0:15825:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1789545839.615938:0:15825:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff994bc2bc3800 00000020:01000004:1.0:1789545839.615953:0:15825:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789545839.615967:0:15825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1789545839.615980:0:15825:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff994bc65dcd40) 00000020:00000080:1.0:1789545839.616020:0:15825:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789545839.642069:0:15825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789545839.643590:0:15825:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789545839.644714:0:15825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789545839.644949:0:15825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1789545839.646271:0:15825:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1789545839.646749:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 270: rc = 0 00100000:10000000:0.0:1789545839.646987:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 270: rc = 0 00100000:10000000:0.0:1789545839.647209:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 270: rc = 0 00100000:10000000:0.0:1789545839.647677:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 237: rc = 0 00100000:10000000:0.0:1789545839.648438:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 237: rc = 0 00100000:10000000:0.0:1789545839.648686:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 237: rc = 0 00100000:10000000:0.0:1789545839.649032:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 237: rc = 0 00100000:10000000:0.0:1789545839.650340:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 237: rc = 0 00100000:10000000:0.0:1789545839.650687:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 237: rc = 0 00000020:00000080:0.0:1789545839.651466:0:15825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1789545839.651478:0:15825:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789545839.651489:0:15825:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x64919c0f856c1860 00000020:01000004:0.0:1789545839.651498:0:15825:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1789545839.651521:0:15825:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.116@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789545839.651525:0:15825:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789545839.651530:0:15825:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789545839.651563:0:15825:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1789545839.651568:0:15825:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.116@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789545839.660882:0:15825:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.116@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789545839.660983:0:15825:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.116@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1789545839.660988:0:15825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789545839.660989:0:15825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789545839.660991:0:15825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789545839.660992:0:15825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789545839.660993:0:15825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789545839.660994:0:15825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789545839.660995:0:15825:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789545839.660997:0:15825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789545839.660998:0:15825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789545839.661002:0:15825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1789545839.661004:0:15825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789545839.661005:0:15825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789545839.661006:0:15825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789545839.661007:0:15825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789545839.661008:0:15825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789545839.661008:0:15825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789545839.661009:0:15825:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789545839.661010:0:15825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789545839.661011:0:15825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789545839.661038:0:15825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789545839.661058:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4798a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454964992:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789545839.661194:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545839.661327:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfadc6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789545839.661551:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454964992 00000100:00100000:2.0:1789545839.661559:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454964992 00000100:00100000:2.0:1789545839.661646:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789545839.661656:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be41ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+16:15825:x1876474454964992:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789545839.661685:0:14417:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789545839.661688:0:14417:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789545839.661692:0:14417:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789545839.671052:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be41ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+16:15825:x1876474454964992:12345-0@lo:253:mount.lustre.0 Request processed in 9389us (9850us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545839.671068:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789545839.671281:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4798a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454964992:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789545839.671297:0:15825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789545839.671301:0:15825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789545839.671303:0:15825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789545839.671304:0:15825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789545839.671306:0:15825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789545839.671307:0:15825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789545839.671332:0:15825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789545839.671333:0:15825:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789545839.671335:0:15825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789545839.671336:0:15825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789545839.671425:0:15825:0:(tgt_mount.c:101:server_register_mount()) register mount ffff994bc2bc3800 from lustre-OST0001 10000000:01000000:1.0:1789545839.671452:0:15825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789545839.671455:0:15825:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789545839.671464:0:15825:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff994bd8da3380 local copy 00010000:00010000:1.0:1789545839.671475:0:15825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d1400/0x64919c0f856c160d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1614 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545839.671704:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454965120:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789545839.671742:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545839.671782:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc4a45240 going to sleep for 11 seconds 00000100:00100000:2.0:1789545839.671849:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454965120 00000100:00100000:2.0:1789545839.671856:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454965120 00000100:00100000:2.0:1789545839.671945:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789545839.671955:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be41ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+16:15825:x1876474454965120:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789545839.672309:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be41ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+16:15825:x1876474454965120:12345-0@lo:501:mount.lustre.0 Request processed in 355us (565us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789545839.672327:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789545839.672402:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454965120:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789545839.672419:0:15825:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789545839.672566:0:15825:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789545839.672573:0:15825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d1400/0x64919c0f856c160d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1614 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545839.672583:0:15825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc49d1400/0x64919c0f856c160d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1614 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789545839.672605:0:15825:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff994bc2bc3800 10000000:01000000:1.0:1789545839.672609:0:15825:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789545839.672615:0:15825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789545839.672618:0:15825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789545839.672622:0:15825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789545839.672625:0:15825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789545839.672650:0:15825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9000/0x64919c0f856c1867 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545839.672665:0:15825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9000/0x64919c0f856c1867 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545839.672675:0:15825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9000/0x64919c0f856c1867 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545839.672691:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454965248:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789545839.672720:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545839.673349:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc4a45240 going to sleep for 11 seconds 00000100:00100000:0.0:1789545839.673500:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454965248 00000100:00100000:0.0:1789545839.673508:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454965248 00000100:00100000:0.0:1789545839.673540:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789545839.673549:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be41efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+16:15825:x1876474454965248:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789545839.673560:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545839.673574:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994be4eb7600/0x64919c0f856c186e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c1867 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545839.673605:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994be4eb7600/0x64919c0f856c186e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c1867 expref: 17 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545839.673615:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994be4eb7600/0x64919c0f856c186e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c1867 expref: 17 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545839.673625:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb7600, rc 0) 00000100:00100000:0.0:1789545839.673675:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be41efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+17:15825:x1876474454965248:12345-0@lo:101:mount.lustre.0 Request processed in 127us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545839.673682:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789545839.673767:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454965248:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789545839.673781:0:15825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9000/0x64919c0f856c1867 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c186e expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545839.673790:0:15825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9000/0x64919c0f856c1867 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c186e expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789545839.674528:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789545839.675345:0:15825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789545839.675621:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789545839.675667:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789545839.675702:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789545839.675752:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789545839.675787:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789545839.675820:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789545839.675885:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789545839.675893:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789545839.675975:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454965376:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789545839.676043:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545839.676102:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc4a45840 going to sleep for 11 seconds 00000100:00100000:0.0:1789545839.676407:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454965376 00000100:00100000:0.0:1789545839.676414:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454965376 00000100:00100000:0.0:1789545839.676449:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789545839.676458:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be41ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+17:15825:x1876474454965376:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789545839.676785:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be41ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+17:15825:x1876474454965376:12345-0@lo:501:mount.lustre.0 Request processed in 327us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545839.676793:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789545839.678901:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454965376:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789545839.678976:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454965504:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789545839.679065:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545839.679223:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc4a45840 going to sleep for 11 seconds 00000100:00100000:2.0:1789545839.679671:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454965504 00000100:00100000:2.0:1789545839.679681:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454965504 00000100:00100000:0.0:1789545839.680015:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789545839.680029:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be41ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+17:15825:x1876474454965504:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789545839.680794:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be41ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+17:15825:x1876474454965504:12345-0@lo:503:mount.lustre.0 Request processed in 767us (1727us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545839.680804:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789545839.680942:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454965504:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789545839.681584:0:15825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789545839.681655:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454965632:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789545839.681708:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545839.681748:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8f96180 going to sleep for 11 seconds 00000100:00100000:0.0:1789545839.682007:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454965632 00000100:00100000:0.0:1789545839.682015:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454965632 00000100:00100000:0.0:1789545839.682043:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789545839.682050:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be41ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+17:15825:x1876474454965632:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789545839.682268:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be41ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+17:15825:x1876474454965632:12345-0@lo:502:mount.lustre.0 Request processed in 217us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545839.682275:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789545839.682467:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454965632:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789545839.682684:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789545839.682732:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789545839.682764:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789545839.682811:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789545839.682848:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789545839.682883:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789545839.683284:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789545839.683352:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789545839.683437:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1789545839.683476:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454965760:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789545839.683534:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545839.683575:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8f96180 going to sleep for 11 seconds 00000100:00100000:0.0:1789545839.683646:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454965760 00000100:00100000:0.0:1789545839.683653:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454965760 00000100:00100000:0.0:1789545839.683685:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789545839.683693:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be41ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+17:15825:x1876474454965760:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789545839.683859:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be41ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+17:15825:x1876474454965760:12345-0@lo:502:mount.lustre.0 Request processed in 165us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545839.683866:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789545839.684343:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454965760:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789545839.684477:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1789545839.684491:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1789545839.686276:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789545839.686289:0:15826:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1789545839.686297:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789545839.686300:0:15826:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789545839.686305:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789545839.686335:0:15826:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff994bc65d99c0) 00000020:00000080:1.0:1789545839.686424:0:15826:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789545839.686433:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789545839.686508:0:15826:0:(tgt_mount.c:153:server_get_mount()) get mount ffff994bc2bc3800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789545839.686517:0:15826:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789545839.686525:0:15826:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x64919c0f856c187c 00010000:00010000:1.0:1789545839.692633:0:15826:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1789545839.693696:0:15826:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1789545839.700217:0:15826:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1789545839.701645:0:15826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789545839.701660:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789545839.701666:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789545839.701668:0:15826:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789545839.701672:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789545839.701676:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789545839.701678:0:15826:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789545839.701681:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789545839.701683:0:15826:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789545839.701685:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789545839.701687:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789545839.701688:0:15826:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789545839.701690:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789545839.701692:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789545839.701694:0:15826:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789545839.701697:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789545839.701754:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789545839.701758:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789545839.701759:0:15826:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789545839.701769:0:15826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1789545839.702546:0:15825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1789545839.702575:0:15825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789545839.702599:0:15825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9000/0x64919c0f856c1867 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c186e expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545839.702620:0:15825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9000/0x64919c0f856c1867 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c186e expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789545839.702629:0:15825:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994bc2bc3800 from 1 10000000:01000000:0.0:1789545839.702632:0:15825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789545839.702672:0:15825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994be4eb6000/0x64919c0f856c1883 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545839.702681:0:15825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994be4eb6000/0x64919c0f856c1883 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545839.702692:0:15825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994be4eb6000/0x64919c0f856c1883 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545839.702730:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4799500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454965888:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789545839.702797:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545839.702845:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bfbf4dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789545839.702922:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454965888 00000100:00100000:1.0:1789545839.702930:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454965888 00000100:00100000:1.0:1789545839.702977:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789545839.702987:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be41ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+17:15825:x1876474454965888:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789545839.703000:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545839.703013:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc8ba8c00/0x64919c0f856c188a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c1883 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545839.703036:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc8ba8c00/0x64919c0f856c188a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c1883 expref: 18 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545839.703048:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc8ba8c00/0x64919c0f856c188a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c1883 expref: 18 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545839.703056:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba8c00, rc 0) 00000100:00100000:1.0:1789545839.703096:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be41ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+18:15825:x1876474454965888:12345-0@lo:101:mount.lustre.0 Request processed in 110us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545839.703102:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789545839.703470:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4799500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454965888:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789545839.703486:0:15825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994be4eb6000/0x64919c0f856c1883 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c188a expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545839.703495:0:15825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994be4eb6000/0x64919c0f856c1883 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c188a expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789545839.705231:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789545839.705854:0:15825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789545839.706114:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1789545839.706161:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1789545839.706228:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1789545839.706237:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1789545839.707622:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4799500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454966016:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789545839.707710:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545839.707768:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bfbf4dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789545839.708041:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454966016 00000100:00100000:2.0:1789545839.708052:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454966016 00000100:00100000:2.0:1789545839.708200:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789545839.708212:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be41ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+18:15825:x1876474454966016:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789545839.708540:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be41ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+18:15825:x1876474454966016:12345-0@lo:501:mount.lustre.0 Request processed in 331us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545839.708548:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789545839.708801:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4799500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454966016:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789545839.708855:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4799500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454966144:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789545839.710044:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545839.710089:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bfbf4dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789545839.710312:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454966144 00000100:00100000:2.0:1789545839.710329:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454966144 00000100:00100000:2.0:1789545839.710402:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789545839.710412:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be41edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+18:15825:x1876474454966144:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789545839.710757:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be41edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+18:15825:x1876474454966144:12345-0@lo:503:mount.lustre.0 Request processed in 346us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545839.710766:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789545839.712073:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4799500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454966144:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789545839.713700:0:15825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789545839.713805:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4799500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454966272:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789545839.713887:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545839.713946:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bfbf4dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789545839.714617:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454966272 00000100:00100000:1.0:1789545839.714627:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454966272 00000100:00100000:1.0:1789545839.714685:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789545839.714694:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+18:15825:x1876474454966272:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789545839.714945:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+18:15825:x1876474454966272:12345-0@lo:502:mount.lustre.0 Request processed in 251us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545839.714952:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789545839.715298:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4799500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454966272:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789545839.715606:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789545839.715660:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789545839.715708:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789545839.715745:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789545839.715777:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789545839.715825:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789545839.715860:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789545839.716199:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1789545839.716246:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4799500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454966400:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789545839.716323:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545839.717817:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bfbf4dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789545839.718193:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454966400 00000100:00100000:2.0:1789545839.718205:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454966400 00000100:00100000:2.0:1789545839.718278:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789545839.718288:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+18:15825:x1876474454966400:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789545839.718620:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+18:15825:x1876474454966400:12345-0@lo:502:mount.lustre.0 Request processed in 333us (2305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545839.718629:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789545839.719244:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4799500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454966400:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789545839.719445:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1789545839.719461:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1789545839.725107:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789545839.725135:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789545839.725137:0:15830:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789545839.725146:0:15830:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff994bc2bc3800 00000020:00000080:0.0:1789545839.725149:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789545839.725156:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789545839.725159:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789545839.725160:0:15830:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789545839.725162:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789545839.725164:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789545839.725165:0:15830:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789545839.725168:0:15830:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff994bc2bc3800 00000020:00000080:0.0:1789545839.725176:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789545839.725232:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789545839.725236:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789545839.725237:0:15830:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789545839.725239:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789545839.725242:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789545839.725243:0:15830:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789545839.725246:0:15830:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff994bc2bc3800 00000020:00000080:0.0:1789545839.725248:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789545839.725283:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789545839.725286:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789545839.725288:0:15830:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789545839.725291:0:15830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1789545839.725477:0:15825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789545839.725507:0:15825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789545839.725535:0:15825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994be4eb6000/0x64919c0f856c1883 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c188a expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545839.725547:0:15825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994be4eb6000/0x64919c0f856c1883 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c188a expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789545839.725597:0:15825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789545839.725601:0:15825:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff994bc2bc3800 10000000:01000000:2.0:1789545839.725605:0:15825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff994bc2bc3800 10000000:01000000:2.0:1789545839.725620:0:15825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789545839.725626:0:15825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff994bc2bc3800 from 1 10000000:01000000:2.0:1789545839.725630:0:15825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789545839.725671:0:15825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d1800/0x64919c0f856c1891 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545839.725686:0:15825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc49d1800/0x64919c0f856c1891 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545839.725699:0:15825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc49d1800/0x64919c0f856c1891 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545839.725727:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4eddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454966528:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789545839.725800:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545839.725847:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff994be4e76540 going to sleep for 11 seconds 00000100:00100000:2.0:1789545839.725872:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454966528 00000100:00100000:2.0:1789545839.725879:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454966528 00000100:00100000:2.0:1789545839.725936:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789545839.725945:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+18:15825:x1876474454966528:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789545839.725958:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545839.725970:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc49d0400/0x64919c0f856c1898 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c1891 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545839.725993:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc49d0400/0x64919c0f856c1898 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c1891 expref: 19 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545839.726004:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc49d0400/0x64919c0f856c1898 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c1891 expref: 19 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545839.726013:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0400, rc 0) 00000100:00100000:2.0:1789545839.726052:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+19:15825:x1876474454966528:12345-0@lo:101:mount.lustre.0 Request processed in 108us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545839.726060:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789545839.726120:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4eddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454966528:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789545839.726134:0:15825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc49d1800/0x64919c0f856c1891 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1898 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545839.726143:0:15825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc49d1800/0x64919c0f856c1891 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c1898 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789545839.726791:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1789545839.727156:0:15825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789545839.727502:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789545839.727545:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789545839.727575:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789545839.727619:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789545839.727654:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789545839.727717:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789545839.727753:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789545839.727784:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789545839.727831:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789545839.727866:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789545839.727900:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789545839.727947:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789545839.727984:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789545839.728035:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789545839.728083:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789545839.728118:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789545839.728150:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789545839.728197:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789545839.728233:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789545839.728266:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789545839.732059:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789545839.732547:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789545839.732587:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789545839.732694:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789545839.732736:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1789545839.732772:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1789545839.732820:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1789545839.732855:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1789545839.733837:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1789545839.733968:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1789545839.734010:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1789545839.734048:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1789545839.734085:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1789545839.734166:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1789545839.734208:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1789545839.734262:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1789545839.734302:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1789545839.734451:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1789545839.734461:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1789545839.734584:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4eddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454966656:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789545839.734658:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545839.734710:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff994be4e76540 going to sleep for 11 seconds 00000100:00100000:0.0:1789545839.736102:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454966656 00000100:00100000:0.0:1789545839.736126:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454966656 00000100:00100000:0.0:1789545839.736188:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789545839.736200:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+19:15825:x1876474454966656:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789545839.736553:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+19:15825:x1876474454966656:12345-0@lo:501:mount.lustre.0 Request processed in 354us (1893us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545839.736561:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789545839.736754:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4eddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454966656:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789545839.736809:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4eddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454966784:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789545839.736863:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545839.736951:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff994be4e76540 going to sleep for 11 seconds 00000100:00100000:0.0:1789545839.744136:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454966784 00000100:00100000:0.0:1789545839.744154:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454966784 00000100:00100000:0.0:1789545839.744217:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789545839.744228:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc4a0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+19:15825:x1876474454966784:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789545839.744506:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc4a0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+19:15825:x1876474454966784:12345-0@lo:503:mount.lustre.0 Request processed in 280us (7642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545839.744515:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789545839.744743:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4eddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454966784:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789545839.745327:0:15825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789545839.745453:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4eddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454966912:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789545839.745515:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545839.745560:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff994be4e76540 going to sleep for 11 seconds 00000100:00100000:0.0:1789545839.746163:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454966912 00000100:00100000:0.0:1789545839.746173:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454966912 00000100:00100000:0.0:1789545839.746221:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789545839.746238:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc6572450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+19:15825:x1876474454966912:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789545839.746517:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc6572450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+19:15825:x1876474454966912:12345-0@lo:502:mount.lustre.0 Request processed in 281us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545839.746524:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789545839.746827:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4eddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454966912:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789545839.747347:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789545839.747432:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789545839.747469:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789545839.747527:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789545839.747576:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789545839.747627:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789545839.747662:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789545839.747697:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789545839.747746:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789545839.747782:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789545839.747820:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789545839.747870:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789545839.749348:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789545839.749417:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789545839.749480:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789545839.749514:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789545839.749545:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789545839.749590:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789545839.749626:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789545839.749658:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789545839.749717:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789545839.749751:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789545839.749783:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789545839.749842:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789545839.751210:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1789545839.751308:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1789545839.751407:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1789545839.751448:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1789545839.751484:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1789545839.751535:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1789545839.751574:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1789545839.751621:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1789545839.751655:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1789545839.751704:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1789545839.751738:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1789545839.751781:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1789545839.751836:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1789545839.751870:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1789545839.754495:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1789545839.754554:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1789545839.754612:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4eddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454967040:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789545839.754717:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545839.754771:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff994be4e76540 going to sleep for 11 seconds 00000100:00100000:0.0:1789545839.755244:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454967040 00000100:00100000:0.0:1789545839.755253:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454967040 00000100:00100000:0.0:1789545839.755321:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789545839.755332:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc6571c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+19:15825:x1876474454967040:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789545839.755987:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc6571c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+19:15825:x1876474454967040:12345-0@lo:502:mount.lustre.0 Request processed in 655us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545839.755998:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789545839.762288:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4eddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454967040:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789545839.762476:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1789545839.762492:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1789545839.766387:0:15834:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789545839.766407:0:15834:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff994bc65db380) 00000020:00000080:1.0:1789545839.766430:0:15834:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1789545839.766528:0:15834:0:(tgt_mount.c:153:server_get_mount()) get mount ffff994bc2bc3800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789545839.766532:0:15834:0:(tgt_mount.c:187:server_put_mount()) put mount ffff994bc2bc3800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789545839.766535:0:15834:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994bc2bc3800 3 00010000:00080000:1.0:1789545839.766575:0:15834:0:(ldlm_lib.c:102:import_set_conn()) imp ffff994ac27f4800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.116@tcp at head 00010000:00010000:1.0:1789545839.771744:0:15834:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1789545839.771972:0:15834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789545839.772011:0:15834:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789545839.772026:0:15834:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x64919c0f856c18a6 00000100:00080000:1.0:1789545839.772038:0:15834:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789545839.772050:0:15834:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff994ac27f4800 using connection 192.168.201.116@tcp/0@lo 00000100:00100000:1.0:1789545839.772090:0:15834:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994be4f40700 x1876474454967168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789545839.772129:0:15834:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789545839.772250:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1876474454967168:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789545839.772334:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545839.774482:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454967168 00000100:00100000:1.0:1789545839.774498:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454967168 00000100:00100000:1.0:1789545839.774541:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789545839.774550:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1876474454967168:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789545839.774578:0:14425:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 453 last 0 00000020:00000080:1.0:1789545839.774620:0:14425:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x64919c0f856c18ad 00000004:00100000:1.0:1789545839.774640:0:14425:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789545839.774680:0:14425:0:(import.c:65:import_set_state_nolock()) ffff994ac27f7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789545839.774782:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876474454967168:12345-0@lo:38:llog_process_th.0 Request processed in 231us (2447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545839.774790:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789545839.775078:0:12196:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789545839.775083:0:12196:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789545839.775086:0:12196:0:(import.c:65:import_set_state_nolock()) ffff994bc8ff8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789545839.775091:0:12196:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 452 00000100:00080000:0.0:1789545839.775095:0:12196:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789545839.775102:0:12196:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff994bc8ff8800 using connection 192.168.201.116@tcp/0@lo 00000100:00100000:0.0:1789545839.775132:0:12196:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994be4798e00 x1876474454967424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789545839.775190:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454967296:0@lo:400:kworker.0 00000100:00100000:0.0:1789545839.775236:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545839.775278:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454967552:0@lo:400:kworker.0 00000100:00100000:0.0:1789545839.775302:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545839.775333:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789545839.775340:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be479a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454967680:0@lo:400:kworker.0 00000100:00100000:0.0:1789545839.775393:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545839.775430:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454967296 00000100:00100000:0.0:1789545839.775435:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454967296 00000100:00100000:0.0:1789545839.775467:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789545839.775475:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1876474454967296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545839.775513:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1876474454967296:12345-0@lo:400:kworker.0 Request processed in 39us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545839.775519:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789545839.775538:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454967552 00000100:00100000:0.0:1789545839.775541:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454967552 00000100:00100000:0.0:1789545839.775562:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454967680 00000100:00100000:0.0:1789545839.775565:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454967680 00000100:00100000:0.0:1789545839.775582:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789545839.775588:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be479b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454967552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545839.775620:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be479b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454967552:12345-0@lo:400:kworker.0 Request processed in 32us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545839.775626:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789545839.775637:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789545839.775642:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454967680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545839.775667:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454967680:12345-0@lo:400:kworker.0 Request processed in 25us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545839.775672:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789545839.775715:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454967296:0@lo:400:kworker.0 00010000:00080000:0.0:1789545839.775750:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994be479a680 x1876474454967680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545839.775760:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be479a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454967680:0@lo:400:kworker.0 00010000:00080000:0.0:1789545839.775781:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994be4799f80 x1876474454967552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545839.775789:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454967552:0@lo:400:kworker.0 00000100:00100000:2.0:1789545839.778252:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876474454967424:0@lo:8:kworker.0 00000100:00100000:2.0:1789545839.778339:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789545839.778417:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994be4f40700 x1876474454967168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789545849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545839.778428:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789545839.778438:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1789545839.778447:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789545839.778453:0:3310:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789545839.778456:0:3310:0:(import.c:65:import_set_state_nolock()) ffff994ac27f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789545839.778463:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1876474454967168:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789545839.778503:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454967424 00000100:00100000:2.0:1789545839.778510:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454967424 00000100:00100000:2.0:1789545839.778548:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789545839.778566:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1876474454967424:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789545839.778630:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1876474454967424:12345-0@lo:8:kworker.0 Request processed in 63us (289us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789545839.778637:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789545839.778665:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789545839.778670:0:3310:0:(import.c:65:import_set_state_nolock()) ffff994bc8ff8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789545839.778674:0:3310:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789545839.778677:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876474454967424:0@lo:8:kworker.0 00000040:00080000:1.0:1789545839.789350:0:15834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1789545839.790015:0:15825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789545839.790060:0:15825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789545839.790089:0:15825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d1800/0x64919c0f856c1891 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1898 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545839.790101:0:15825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc49d1800/0x64919c0f856c1891 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1898 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789545839.791043:0:15825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789545839.791047:0:15825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789545839.791048:0:15825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789545839.791049:0:15825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789545839.791051:0:15825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789545839.791053:0:15825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789545839.791054:0:15825:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789545839.791056:0:15825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789545839.791062:0:15825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789545839.791066:0:15825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1789545839.791070:0:15825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789545839.791071:0:15825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789545839.791072:0:15825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789545839.791073:0:15825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789545839.791073:0:15825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789545839.791074:0:15825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789545839.791075:0:15825:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789545839.791076:0:15825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789545839.791077:0:15825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789545839.791107:0:15825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789545839.792007:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454967808:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789545839.792091:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545839.792204:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc3832b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789545839.792298:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454967808 00000100:00100000:0.0:1789545839.792310:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454967808 00000100:00100000:0.0:1789545839.792391:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789545839.792413:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdb2f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+19:15825:x1876474454967808:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789545839.792447:0:14416:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789545839.792463:0:14416:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789545839.834206:0:14416:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789545839.834262:0:14416:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789545839.835018:0:14439:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789545839.835024:0:14439:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789545839.835049:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff994be4eb6400/0x64919c0f856c18b4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545839.835067:0:14439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bc8ba9a00/0x64919c0f856c178e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c1787 expref: 19 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545839.835077:0:14439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff994be4eb6400/0x64919c0f856c18b4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545839.835193:0:14439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bc8ba9a00/0x64919c0f856c178e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c1787 expref: 19 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545839.835208:0:14439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994bc8ba9a00/0x64919c0f856c178e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c1787 expref: 19 pid: 14418 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545839.835221:0:14439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4799f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14439:1876474454967936:0@lo:104: 00000100:00100000:0.0:1789545839.835285:0:14439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545839.835414:0:14439:0:(client.c:2716:ptlrpc_set_wait()) set ffff994ac2b53cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789545839.837074:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454967936 00000100:00100000:2.0:1789545839.837089:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454967936 00000100:00100000:2.0:1789545839.837155:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789545839.837165:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be479a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6de5819a-62ff-4f85-af03-c287b54b27c1+3:14439:x1876474454967936:12345-0@lo:104: 00010000:00010000:2.0:1789545839.837183:0:14406:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c1787 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c178e expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545839.837284:0:14406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789545839.837290:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be479a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6de5819a-62ff-4f85-af03-c287b54b27c1+3:14439:x1876474454967936:12345-0@lo:104: Request processed in 127us (2004us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545839.837297:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789545839.837328:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789545839.837334:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c1787 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c178e expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545839.837342:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6c00 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:2.0:1789545839.837346:0:14411:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c1787 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c178e expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545839.837356:0:14411:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c1787 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c178e expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789545839.837396:0:14411:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c1787 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c178e expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789545839.837401:0:14411:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789545839.837441:0:14411:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c1787 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c178e expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545839.837447:0:14411:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789545839.837468:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c1787 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c178e expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545839.837474:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994be4eb6c00/0x64919c0f856c1787 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c178e expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545839.837491:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545839.837493:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545839.837495:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545839.837517:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6de5819a-62ff-4f85-af03-c287b54b27c1:3311:1876474454968064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789545839.837553:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545839.837762:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454968064 00000100:00100000:3.0:1789545839.837767:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454968064 00010000:00010000:3.0:1789545839.837790:0:14409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bc8ba9a00/0x64919c0f856c178e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c1787 expref: 20 pid: 14418 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545839.837821:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789545839.837828:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ede680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6de5819a-62ff-4f85-af03-c287b54b27c1+20:3311:x1876474454968064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789545839.837838:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545839.837844:0:14409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bc8ba9a00/0x64919c0f856c178e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c1787 expref: 20 pid: 14418 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545839.837853:0:14409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bc8ba9a00/0x64919c0f856c178e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c1787 expref: 20 pid: 14418 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545839.837871:0:14409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff994be4eb6400/0x64919c0f856c18b4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545839.837880:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994be4eb6400/0x64919c0f856c18b4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789545839.837913:0:14409:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002889381s 00010000:00010000:3.0:1789545839.837918:0:14409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994be4eb6400/0x64919c0f856c18b4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545839.837925:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994be4eb6400/0x64919c0f856c18b4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545839.837932:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff994be4eb6400/0x64919c0f856c18b4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545839.837939:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff994be4eb6400/0x64919c0f856c18b4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545839.837944:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6400 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545839.837948:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff994be4eb6400/0x64919c0f856c18b4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545839.837955:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff994be4eb6400/0x64919c0f856c18b4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545839.837964:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff994be4eb6400/0x64919c0f856c18b4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545839.837973:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545839.838014:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ede680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6de5819a-62ff-4f85-af03-c287b54b27c1+20:3311:x1876474454968064:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545839.838021:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789545839.838062:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc8ba9a00/0x64919c0f856c178e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c1787 expref: 19 pid: 14418 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545839.838085:0:14439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4799f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14439:1876474454967936:0@lo:104: 00010000:00010000:3.0:1789545839.838260:0:14439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff994be4eb6400/0x64919c0f856c18b4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545839.838271:0:14439:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff994be4eb6400/0x64919c0f856c18b4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545839.838277:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff994be4eb6400/0x64919c0f856c18b4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545839.838283:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994be4eb6400/0x64919c0f856c18b4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545839.838349:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6de5819a-62ff-4f85-af03-c287b54b27c1:3311:1876474454968064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789545839.845032:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdb2f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+18:15825:x1876474454967808:12345-0@lo:253:mount.lustre.0 Request processed in 52620us (52929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545839.845066:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789545839.845436:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6de5819a-62ff-4f85-af03-c287b54b27c1:15825:1876474454967808:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789545839.845456:0:15825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789545839.845460:0:15825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789545839.845461:0:15825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789545839.845463:0:15825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789545839.845464:0:15825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789545839.845465:0:15825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789545839.845467:0:15825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789545839.845468:0:15825:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789545839.845470:0:15825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789545839.845471:0:15825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789545839.845492:0:15825:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789545839.850403:0:15825:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789545839.850572:0:15825:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789545839.850728:0:15825:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789545839.850876:0:15825:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789545839.851103:0:15825:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789545839.851560:0:15825:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789545839.852406:0:15825:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789545839.913253:0:15825:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789545839.913264:0:15825:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789545839.913305:0:15825:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789545839.913405:0:15825:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.116@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789545839.913422:0:15825:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789545839.913453:0:15825:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1789545840.195032:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545841.212554:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789545841.596592:0:14420:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789545841.596606:0:14420:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff994bdfb81000 from 8 10000000:01000000:2.0:1789545841.596613:0:14420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789545841.596682:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d0a00/0x64919c0f856c18bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545841.596699:0:14420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc49d0a00/0x64919c0f856c18bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545841.596715:0:14420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc49d0a00/0x64919c0f856c18bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545841.596751:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454968192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789545841.596846:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545841.597677:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8e38300 going to sleep for 11 seconds 00000100:00100000:1.0:1789545841.599329:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454968192 00000100:00100000:1.0:1789545841.599349:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454968192 00000100:00100000:1.0:1789545841.599450:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789545841.599463:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdb2f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+18:14420:x1876474454968192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789545841.599488:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545841.599515:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc8ba9c00/0x64919c0f856c18c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c18bb expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545841.599551:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc8ba9c00/0x64919c0f856c18c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c18bb expref: 19 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545841.599565:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc8ba9c00/0x64919c0f856c18c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c18bb expref: 19 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545841.599578:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba9c00, rc 0) 00000100:00100000:1.0:1789545841.599690:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdb2f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+19:14420:x1876474454968192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 230us (2843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545841.599698:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789545841.599776:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454968192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789545841.599800:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc49d0a00/0x64919c0f856c18bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c18c2 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545841.599812:0:14420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc49d0a00/0x64919c0f856c18bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c18c2 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545841.599902:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f40a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454968320:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789545841.599980:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545841.600023:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd939f840 going to sleep for 11 seconds 00000100:00100000:2.0:1789545841.600432:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454968320 00000100:00100000:2.0:1789545841.600441:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454968320 00000100:00100000:2.0:1789545841.600486:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789545841.600495:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdb2f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+19:14420:x1876474454968320:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789545841.600516:0:14417:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789545841.600538:0:14417:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789545841.600541:0:14417:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1789545841.600639:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdb2f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+19:14420:x1876474454968320:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 145us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545841.600647:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789545841.601502:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f40a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454968320:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789545841.601608:0:14420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789545841.601623:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc49d0a00/0x64919c0f856c18bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c18c2 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545841.601636:0:14420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc49d0a00/0x64919c0f856c18bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c18c2 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789545841.910689:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1789545841.910758:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1789545842.236985:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545843.261473:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545843.777120:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454968448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789545843.777229:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545843.777479:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454968448 00000100:00100000:0.0:1789545843.777490:0:15111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454968448 00000100:00100000:0.0:1789545843.777561:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789545843.777573:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454968448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789545843.777619:0:15111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789545843.777674:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454968448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545843.777682:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789545843.777712:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789545843.777750:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789545843.780566:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454968448:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789545844.284697:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789545844.796706:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789545844.796715:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789545844.796719:0:36:0:(import.c:65:import_set_state_nolock()) ffff994bc8ff8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789545844.796738:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff994bc8ff8800 using connection 192.168.201.116@tcp/0@lo 00000100:00100000:0.0:1789545844.796765:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994be4798e00 x1876474454968832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789545844.796916:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6de5819a-62ff-4f85-af03-c287b54b27c1:3313:1876474454968576:0@lo:400:kworker.0 00000100:00100000:1.0:1789545844.797013:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545844.797943:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876474454968832:0@lo:8:kworker.0 00000100:00100000:0.0:1789545844.797998:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545844.798045:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454968960:0@lo:400:kworker.0 00000100:00100000:0.0:1789545844.798074:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545844.798094:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876474454969088:0@lo:400:kworker.0 00000100:00100000:0.0:1789545844.798115:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545844.798162:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454968832 00000100:00100000:0.0:1789545844.798180:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454968832 00000100:00100000:0.0:1789545844.798233:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789545844.798241:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1876474454968832:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789545844.798277:0:15109:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 458 last 0 00000020:00000080:0.0:1789545844.798314:0:15109:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x64919c0f856c18c9 00002000:00100000:0.0:1789545844.798330:0:15109:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff994ac198d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789545844.798335:0:15109:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789545844.798338:0:15109:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789545844.798738:0:15109:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789545844.798769:0:15109:0:(import.c:65:import_set_state_nolock()) ffff994ac198a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789545844.798839:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1876474454968832:12345-0@lo:8:kworker.0 Request processed in 596us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545844.798847:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789545844.798887:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454968960 00000100:00100000:0.0:1789545844.798892:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454968960 00000100:00100000:0.0:1789545844.798920:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454969088 00000100:00100000:0.0:1789545844.798922:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454969088 00000100:00100000:0.0:1789545844.798948:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789545844.798954:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454968960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545844.798988:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454968960:12345-0@lo:400:kworker.0 Request processed in 35us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545844.798994:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789545844.799005:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789545844.799010:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876474454969088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545844.799035:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876474454969088:12345-0@lo:400:kworker.0 Request processed in 25us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545844.799053:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1789545844.799081:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789545844.799127:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454968576 00000100:00100000:0.0:1789545844.799131:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454968576 00000100:00100000:0.0:1789545844.799154:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789545844.799159:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdb2f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+19:3313:x1876474454968576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545844.799190:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdb2f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+19:3313:x1876474454968576:12345-0@lo:400:kworker.0 Request processed in 31us (2177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545844.799195:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789545844.799389:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6de5819a-62ff-4f85-af03-c287b54b27c1:3313:1876474454968576:0@lo:400:kworker.0 00000100:00100000:1.0:1789545844.799423:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be479b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876474454969216:0@lo:400:kworker.0 00000100:00100000:1.0:1789545844.799459:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545844.799503:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454969216 00000100:00100000:1.0:1789545844.799506:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454969216 00000100:00100000:1.0:1789545844.799533:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789545844.799538:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876474454969216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545844.799567:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876474454969216:12345-0@lo:400:kworker.0 Request processed in 29us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545844.799572:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1789545844.799593:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789545844.799695:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454968704:0@lo:400:kworker.0 00000100:00100000:3.0:1789545844.799728:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545844.799890:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454968704 00000100:00100000:1.0:1789545844.799894:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454968704 00000100:00100000:1.0:1789545844.799926:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789545844.799933:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454968704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545844.799968:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454968704:12345-0@lo:400:kworker.0 Request processed in 36us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545844.799974:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789545844.801556:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be4798e00 x1876474454968832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789545869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789545844.801583:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789545844.801594:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789545844.801602:0:3310:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789545844.801607:0:3310:0:(import.c:65:import_set_state_nolock()) ffff994bc8ff8800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00010000:00080000:2.0:1789545844.801738:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be4798a80 x1876474454968960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545844.801773:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454968960:0@lo:400:kworker.0 00010000:00080000:2.0:1789545844.801861:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be4798700 x1876474454969088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545844.801871:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876474454969088:0@lo:400:kworker.0 00010000:00080000:2.0:1789545844.801913:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be479b100 x1876474454969216/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545844.801924:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be479b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876474454969216:0@lo:400:kworker.0 00000100:00100000:2.0:1789545844.801964:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454968704:0@lo:400:kworker.0 00000004:00080000:0.0:1789545844.804316:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789545844.804340:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876474454968832:0@lo:8:kworker.0 00000004:00080000:2.0:1789545844.804925:0:14447:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789545844.805585:0:14447:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 458728224894ns, next at 0ns, rc = 0 00000004:00080000:3.0:1789545844.810274:0:14448:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1789545844.810318:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14448:1876474454969472:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789545844.810448:0:14448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545844.810489:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfadc600 going to sleep for 11 seconds 00000100:00100000:3.0:1789545844.810543:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454969344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789545844.810575:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545844.814187:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454969344 00000100:00100000:0.0:1789545844.814207:0:15111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454969344 00000100:00100000:0.0:1789545844.814320:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789545844.814332:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876474454969344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789545844.814413:0:15111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789545844.814676:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454969472 00000100:00100000:2.0:1789545844.814683:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454969472 00000100:00100000:2.0:1789545844.814729:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789545844.814737:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14448:x1876474454969472:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789545844.815351:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1876474454969344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1019us (4773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545844.815385:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789545844.817524:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789545844.817634:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be4b3fb80 x1876474454969344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789545860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545844.817674:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454969344:0@lo:13:osp-pre-1-0.0 00002000:00080000:2.0:1789545844.846554:0:15107:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789545844.846571:0:15107:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1789545844.846578:0:15107:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:2.0:1789545844.878726:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545844.878740:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000392cd61/0x64919c0f856c18d0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.878756:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1789545844.878761:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545844.878774:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000392cd61/0x64919c0f856c18d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.878793:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000392cd61/0x64919c0f856c18d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.878806:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000392cd61/0x64919c0f856c18d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.878814:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000392cd61/0x64919c0f856c18d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.878844:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789545844.879332:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545844.879339:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005927aa7d/0x64919c0f856c18d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.879349:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1789545844.879352:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545844.879356:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005927aa7d/0x64919c0f856c18d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.879395:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005927aa7d/0x64919c0f856c18d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.879403:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005927aa7d/0x64919c0f856c18d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.879422:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005927aa7d/0x64919c0f856c18d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.879437:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789545844.879473:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789545844.879491:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000392cd61/0x64919c0f856c18d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.879507:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1c00 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545844.879515:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000392cd61/0x64919c0f856c18d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.879529:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000392cd61/0x64919c0f856c18d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.879564:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000392cd61/0x64919c0f856c18d0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.879575:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000392cd61/0x64919c0f856c18d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.879621:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789545844.879637:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005927aa7d/0x64919c0f856c18d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.879645:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0200 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545844.879650:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005927aa7d/0x64919c0f856c18d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.879659:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005927aa7d/0x64919c0f856c18d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.879670:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005927aa7d/0x64919c0f856c18d7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.879679:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005927aa7d/0x64919c0f856c18d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.879701:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545844.879703:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545844.879705:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545844.879884:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545844.879892:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c18de lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.879902:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1789545844.879905:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545844.879909:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c18de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.879918:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c18de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.879926:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c18de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.879933:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c18de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.879944:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789545844.880145:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789545844.880156:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c18de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545844.880174:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1200 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:1.0:1789545844.880178:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c18de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545844.880187:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c18de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545844.880207:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c18de lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545844.880215:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c18de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545844.880251:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545844.880253:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545844.880256:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545844.880357:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545844.880384:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c118d3c/0x64919c0f856c18e5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.880395:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1789545844.880397:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545844.880400:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c118d3c/0x64919c0f856c18e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.880407:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c118d3c/0x64919c0f856c18e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.880412:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c118d3c/0x64919c0f856c18e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.880417:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c118d3c/0x64919c0f856c18e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.880433:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789545844.880633:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789545844.880641:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c118d3c/0x64919c0f856c18e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545844.880649:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1600 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:1.0:1789545844.880654:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c118d3c/0x64919c0f856c18e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545844.880663:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c118d3c/0x64919c0f856c18e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545844.880679:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c118d3c/0x64919c0f856c18e5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545844.880686:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c118d3c/0x64919c0f856c18e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545844.880716:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545844.880720:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545844.880726:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545844.880784:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545844.880791:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7071d9c/0x64919c0f856c18ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.880798:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1789545844.880801:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545844.880804:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7071d9c/0x64919c0f856c18ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.880811:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7071d9c/0x64919c0f856c18ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.880826:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7071d9c/0x64919c0f856c18ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.880830:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7071d9c/0x64919c0f856c18ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.880845:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789545844.881159:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:2.0:1789545844.881169:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545844.881174:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031b6c5ca/0x64919c0f856c18f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.881181:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1789545844.881183:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545844.881185:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031b6c5ca/0x64919c0f856c18f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.881193:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031b6c5ca/0x64919c0f856c18f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.881201:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031b6c5ca/0x64919c0f856c18f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.881208:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031b6c5ca/0x64919c0f856c18f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.881283:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7071d9c/0x64919c0f856c18ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.881293:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1e00 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545844.881298:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7071d9c/0x64919c0f856c18ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.881324:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7071d9c/0x64919c0f856c18ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.881527:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7071d9c/0x64919c0f856c18ec lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.881535:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7071d9c/0x64919c0f856c18ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.881557:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545844.881558:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545844.881560:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545844.881622:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545844.885465:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789545844.885492:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789545844.885502:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031b6c5ca/0x64919c0f856c18f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.885514:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0000 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:2.0:1789545844.885519:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031b6c5ca/0x64919c0f856c18f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.885532:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031b6c5ca/0x64919c0f856c18f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.885557:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031b6c5ca/0x64919c0f856c18f3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.885638:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031b6c5ca/0x64919c0f856c18f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.885668:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545844.885670:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545844.885672:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545844.889463:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545844.889478:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c18fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.889495:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1789545844.889509:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545844.889516:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c18fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.889534:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c18fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.889545:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c18fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.889623:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c18fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.889649:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789545844.890721:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789545844.890739:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c18fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545844.890756:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1200 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:1.0:1789545844.890763:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c18fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545844.890799:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c18fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545844.890830:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c18fa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545844.890838:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c18fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545844.890879:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545844.890882:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545844.890883:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545844.892046:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545844.892060:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d590cfc/0x64919c0f856c1901 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.892075:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1789545844.892079:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545844.892085:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d590cfc/0x64919c0f856c1901 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.892100:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d590cfc/0x64919c0f856c1901 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.892111:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d590cfc/0x64919c0f856c1901 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.892127:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d590cfc/0x64919c0f856c1901 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.892155:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789545844.892175:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789545844.892181:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d590cfc/0x64919c0f856c1901 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.892189:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc0031e00 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:2.0:1789545844.892193:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d590cfc/0x64919c0f856c1901 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.892204:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d590cfc/0x64919c0f856c1901 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.892233:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d590cfc/0x64919c0f856c1901 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.892241:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d590cfc/0x64919c0f856c1901 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.892269:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545844.892271:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545844.892273:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545844.897417:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545844.897448:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3af030a/0x64919c0f856c1908 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.897466:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1789545844.897471:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545844.897476:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3af030a/0x64919c0f856c1908 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.900727:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3af030a/0x64919c0f856c1908 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.900842:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3af030a/0x64919c0f856c1908 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.900852:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3af030a/0x64919c0f856c1908 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.900892:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789545844.900981:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789545844.900989:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3af030a/0x64919c0f856c1908 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.900997:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc0030a00 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:2.0:1789545844.901003:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3af030a/0x64919c0f856c1908 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.901013:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3af030a/0x64919c0f856c1908 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.901051:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3af030a/0x64919c0f856c1908 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.901059:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3af030a/0x64919c0f856c1908 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.901094:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545844.901096:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545844.901099:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789545844.906995:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:2.0:1789545844.907121:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545844.907131:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002347ac73/0x64919c0f856c190f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.907148:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1789545844.907153:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545844.907160:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002347ac73/0x64919c0f856c190f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.907176:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002347ac73/0x64919c0f856c190f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.907187:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002347ac73/0x64919c0f856c190f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.907196:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002347ac73/0x64919c0f856c190f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.908200:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789545844.908979:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789545844.908990:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002347ac73/0x64919c0f856c190f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.909003:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc0030e00 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:2.0:1789545844.909009:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002347ac73/0x64919c0f856c190f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.909022:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002347ac73/0x64919c0f856c190f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.909043:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002347ac73/0x64919c0f856c190f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.909052:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002347ac73/0x64919c0f856c190f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.909084:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545844.909086:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545844.909087:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545844.914055:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545844.914071:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e478bf5d/0x64919c0f856c1916 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.914088:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1789545844.914102:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545844.914109:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e478bf5d/0x64919c0f856c1916 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.914122:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e478bf5d/0x64919c0f856c1916 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.914132:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e478bf5d/0x64919c0f856c1916 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.914140:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e478bf5d/0x64919c0f856c1916 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.914164:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789545844.914183:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789545844.914188:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e478bf5d/0x64919c0f856c1916 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.914198:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc0030000 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:2.0:1789545844.914202:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e478bf5d/0x64919c0f856c1916 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.914211:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e478bf5d/0x64919c0f856c1916 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.914236:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e478bf5d/0x64919c0f856c1916 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.914255:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e478bf5d/0x64919c0f856c1916 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.914840:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545844.914845:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545844.914848:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545844.916192:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545844.916204:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e749ae9a/0x64919c0f856c191d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.916228:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1789545844.916233:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545844.916238:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e749ae9a/0x64919c0f856c191d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.916250:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e749ae9a/0x64919c0f856c191d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.916260:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e749ae9a/0x64919c0f856c191d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.916267:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e749ae9a/0x64919c0f856c191d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.916350:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789545844.916727:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789545844.916807:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e749ae9a/0x64919c0f856c191d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.916817:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc0031400 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:2.0:1789545844.916822:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e749ae9a/0x64919c0f856c191d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.916830:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e749ae9a/0x64919c0f856c191d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.916847:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e749ae9a/0x64919c0f856c191d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.916855:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e749ae9a/0x64919c0f856c191d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.916878:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545844.916879:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545844.916881:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545844.921853:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545844.921869:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac2fd6e6/0x64919c0f856c1924 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.921887:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1789545844.921892:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545844.921898:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac2fd6e6/0x64919c0f856c1924 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.921930:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac2fd6e6/0x64919c0f856c1924 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.921942:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac2fd6e6/0x64919c0f856c1924 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.921949:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac2fd6e6/0x64919c0f856c1924 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.921978:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789545844.922279:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789545844.922296:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac2fd6e6/0x64919c0f856c1924 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.922312:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc0031a00 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545844.922318:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac2fd6e6/0x64919c0f856c1924 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.922331:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac2fd6e6/0x64919c0f856c1924 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.923106:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac2fd6e6/0x64919c0f856c1924 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.923135:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac2fd6e6/0x64919c0f856c1924 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.923900:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545844.923906:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545844.923909:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545844.925036:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545844.925050:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8b679b1/0x64919c0f856c192b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.925067:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1789545844.925072:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545844.925078:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8b679b1/0x64919c0f856c192b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.925093:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8b679b1/0x64919c0f856c192b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.925103:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8b679b1/0x64919c0f856c192b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.925125:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8b679b1/0x64919c0f856c192b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.925160:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789545844.925280:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789545844.925293:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8b679b1/0x64919c0f856c192b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.925308:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc0031600 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545844.925314:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8b679b1/0x64919c0f856c192b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.925325:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8b679b1/0x64919c0f856c192b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789545844.925852:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545844.925862:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5820da2/0x64919c0f856c1932 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.925873:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1789545844.925877:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545844.925883:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5820da2/0x64919c0f856c1932 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.925895:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5820da2/0x64919c0f856c1932 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.925906:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5820da2/0x64919c0f856c1932 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.925914:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5820da2/0x64919c0f856c1932 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.925944:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789545844.926733:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545844.926742:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0f9331e/0x64919c0f856c1939 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.926763:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1789545844.926767:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545844.926773:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0f9331e/0x64919c0f856c1939 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.926785:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0f9331e/0x64919c0f856c1939 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.926794:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0f9331e/0x64919c0f856c1939 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.926802:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0f9331e/0x64919c0f856c1939 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.926811:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789545844.926914:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8b679b1/0x64919c0f856c192b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.926930:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8b679b1/0x64919c0f856c192b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.927010:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789545844.927017:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5820da2/0x64919c0f856c1932 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789545844.927268:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545844.927275:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c0d37c5/0x64919c0f856c1940 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.927284:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1789545844.927287:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545844.927291:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c0d37c5/0x64919c0f856c1940 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.927301:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c0d37c5/0x64919c0f856c1940 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.927320:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c0d37c5/0x64919c0f856c1940 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.927327:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c0d37c5/0x64919c0f856c1940 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.927336:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789545844.927767:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545844.927774:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1b54449/0x64919c0f856c1947 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.927783:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1789545844.927786:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545844.927790:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1b54449/0x64919c0f856c1947 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.927798:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1b54449/0x64919c0f856c1947 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.927808:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1b54449/0x64919c0f856c1947 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.927815:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1b54449/0x64919c0f856c1947 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.927836:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789545844.927946:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc0030400 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545844.927954:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5820da2/0x64919c0f856c1932 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.927966:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5820da2/0x64919c0f856c1932 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.927992:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5820da2/0x64919c0f856c1932 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.928000:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5820da2/0x64919c0f856c1932 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.929144:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789545844.929155:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0f9331e/0x64919c0f856c1939 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.929252:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc0031800 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545844.929256:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0f9331e/0x64919c0f856c1939 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.929266:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0f9331e/0x64919c0f856c1939 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.929286:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0f9331e/0x64919c0f856c1939 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.929305:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0f9331e/0x64919c0f856c1939 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.929326:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789545844.929330:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c0d37c5/0x64919c0f856c1940 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.929336:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc0031000 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545844.929339:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c0d37c5/0x64919c0f856c1940 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.929347:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c0d37c5/0x64919c0f856c1940 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.929373:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c0d37c5/0x64919c0f856c1940 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.929382:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c0d37c5/0x64919c0f856c1940 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.929395:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789545844.929399:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1b54449/0x64919c0f856c1947 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.929406:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994ac2be8e00 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545844.929416:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1b54449/0x64919c0f856c1947 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.929424:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1b54449/0x64919c0f856c1947 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.929435:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1b54449/0x64919c0f856c1947 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.929442:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1b54449/0x64919c0f856c1947 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.929463:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545844.929465:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545844.929467:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545844.929976:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545844.929980:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545844.929982:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545844.937591:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545844.937612:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000856dfc04/0x64919c0f856c194e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.937630:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1789545844.937635:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545844.937642:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000856dfc04/0x64919c0f856c194e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.937657:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000856dfc04/0x64919c0f856c194e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.937668:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000856dfc04/0x64919c0f856c194e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.937676:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000856dfc04/0x64919c0f856c194e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.937706:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789545844.937744:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789545844.937761:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000856dfc04/0x64919c0f856c194e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.937776:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994ac2be8c00 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545844.937782:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000856dfc04/0x64919c0f856c194e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.937796:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000856dfc04/0x64919c0f856c194e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.937835:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000856dfc04/0x64919c0f856c194e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.937853:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000856dfc04/0x64919c0f856c194e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.937901:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545844.937904:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545844.937907:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545844.938336:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545844.938344:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000354ef455/0x64919c0f856c1955 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.938354:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1789545844.938390:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545844.938396:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000354ef455/0x64919c0f856c1955 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.938408:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000354ef455/0x64919c0f856c1955 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.938418:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000354ef455/0x64919c0f856c1955 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.938424:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000354ef455/0x64919c0f856c1955 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.938446:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789545844.938847:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545844.938852:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fffff8f5/0x64919c0f856c195c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.938860:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1789545844.938863:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545844.938867:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fffff8f5/0x64919c0f856c195c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.938875:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fffff8f5/0x64919c0f856c195c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.938883:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fffff8f5/0x64919c0f856c195c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.938895:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fffff8f5/0x64919c0f856c195c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.938913:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789545844.938958:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789545844.938970:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000354ef455/0x64919c0f856c1955 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.938982:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994ac2be8600 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545844.938987:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000354ef455/0x64919c0f856c1955 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.938997:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000354ef455/0x64919c0f856c1955 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.939019:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000354ef455/0x64919c0f856c1955 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.939037:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000354ef455/0x64919c0f856c1955 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.939071:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789545844.939076:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fffff8f5/0x64919c0f856c195c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.939095:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994ac2be9200 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545844.939099:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fffff8f5/0x64919c0f856c195c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.939107:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fffff8f5/0x64919c0f856c195c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.939120:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fffff8f5/0x64919c0f856c195c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.939127:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fffff8f5/0x64919c0f856c195c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.939158:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545844.939160:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545844.939162:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545844.939397:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545844.939405:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065782b09/0x64919c0f856c1963 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.939415:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1789545844.939418:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545844.939423:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065782b09/0x64919c0f856c1963 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.939432:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065782b09/0x64919c0f856c1963 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.939440:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065782b09/0x64919c0f856c1963 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.939448:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065782b09/0x64919c0f856c1963 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.939467:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789545844.939495:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789545844.939504:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065782b09/0x64919c0f856c1963 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.939514:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994ac2be9c00 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545844.939518:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065782b09/0x64919c0f856c1963 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.939529:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065782b09/0x64919c0f856c1963 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.939554:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065782b09/0x64919c0f856c1963 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.939563:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065782b09/0x64919c0f856c1963 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.939596:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545844.939599:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545844.939602:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545844.939911:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545844.939919:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000608021fa/0x64919c0f856c196a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.939934:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1789545844.939937:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545844.939940:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000608021fa/0x64919c0f856c196a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.939949:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000608021fa/0x64919c0f856c196a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.939958:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000608021fa/0x64919c0f856c196a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.939965:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000608021fa/0x64919c0f856c196a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.946353:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789545844.948062:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545844.948074:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003450fb49/0x64919c0f856c1971 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.948091:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1789545844.948095:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545844.948102:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003450fb49/0x64919c0f856c1971 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.948116:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003450fb49/0x64919c0f856c1971 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.948137:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003450fb49/0x64919c0f856c1971 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.948145:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003450fb49/0x64919c0f856c1971 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545844.949847:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789545844.949871:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000608021fa/0x64919c0f856c196a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545844.949888:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994ac2be8800 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:0.0:1789545844.949894:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000608021fa/0x64919c0f856c196a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545844.949908:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000608021fa/0x64919c0f856c196a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545844.949946:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000608021fa/0x64919c0f856c196a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545844.949956:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000608021fa/0x64919c0f856c196a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545844.950005:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789545844.950017:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003450fb49/0x64919c0f856c1971 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545844.950201:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994ac2be9600 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:0.0:1789545844.950205:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003450fb49/0x64919c0f856c1971 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545844.950213:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003450fb49/0x64919c0f856c1971 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545844.950236:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003450fb49/0x64919c0f856c1971 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545844.950246:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545844.950247:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789545844.950250:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545844.959031:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545844.962076:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789545844.962185:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545844.962623:0:15107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003450fb49/0x64919c0f856c1971 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789545844.964641:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545844.964654:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e05e917/0x64919c0f856c1978 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.964669:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1789545844.964674:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545844.964681:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e05e917/0x64919c0f856c1978 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.964694:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e05e917/0x64919c0f856c1978 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.964703:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e05e917/0x64919c0f856c1978 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.964723:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e05e917/0x64919c0f856c1978 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.964811:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789545844.965066:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789545844.965082:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e05e917/0x64919c0f856c1978 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.965097:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994ac2be8400 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545844.965103:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e05e917/0x64919c0f856c1978 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.965116:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e05e917/0x64919c0f856c1978 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.965146:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e05e917/0x64919c0f856c1978 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.965155:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e05e917/0x64919c0f856c1978 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.965227:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545844.965230:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545844.965232:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789545844.966139:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545844.966150:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017799f2b/0x64919c0f856c197f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.966162:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1789545844.966166:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545844.966170:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017799f2b/0x64919c0f856c197f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.966191:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017799f2b/0x64919c0f856c197f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.966200:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017799f2b/0x64919c0f856c197f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.966207:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017799f2b/0x64919c0f856c197f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.966304:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789545844.969519:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545844.969535:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028d677ad/0x64919c0f856c1986 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.970006:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1789545844.970011:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545844.970018:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028d677ad/0x64919c0f856c1986 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.970032:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028d677ad/0x64919c0f856c1986 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.970043:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028d677ad/0x64919c0f856c1986 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.970051:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028d677ad/0x64919c0f856c1986 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.970148:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789545844.970158:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017799f2b/0x64919c0f856c197f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.970167:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994ac2be8200 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545844.970172:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017799f2b/0x64919c0f856c197f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.970182:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017799f2b/0x64919c0f856c197f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.970206:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017799f2b/0x64919c0f856c197f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.970214:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017799f2b/0x64919c0f856c197f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.970272:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789545844.970277:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028d677ad/0x64919c0f856c1986 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.970293:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994ac2be9800 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545844.970305:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028d677ad/0x64919c0f856c1986 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.970314:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028d677ad/0x64919c0f856c1986 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.970325:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028d677ad/0x64919c0f856c1986 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.970335:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545844.970336:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545844.970338:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545844.975728:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789545844.975745:0:15107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028d677ad/0x64919c0f856c1986 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789545844.976875:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789545844.976887:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099f6b1dc/0x64919c0f856c198d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.976900:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1789545844.976905:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545844.976970:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099f6b1dc/0x64919c0f856c198d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.977001:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099f6b1dc/0x64919c0f856c198d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.977012:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099f6b1dc/0x64919c0f856c198d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545844.977019:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099f6b1dc/0x64919c0f856c198d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.978726:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789545844.978741:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099f6b1dc/0x64919c0f856c198d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.978754:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994ac2be9400 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545844.978758:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099f6b1dc/0x64919c0f856c198d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.978767:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099f6b1dc/0x64919c0f856c198d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.978789:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099f6b1dc/0x64919c0f856c198d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545844.979657:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545844.979665:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789545844.979668:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545844.980758:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789545844.980775:0:15107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099f6b1dc/0x64919c0f856c198d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545844.980970:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1789545844.981394:0:15107:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1789545844.982045:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14448:1876474454969472:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789545844.982073:0:14448:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1789545844.982137:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4eddf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14448:1876474454969600:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789545844.982182:0:14448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545844.982237:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdf9753c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789545844.982255:0:15109:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789545844.982263:0:15109:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789545844.982505:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14448:x1876474454969472:12345-0@lo:5:osp-pre-1-0.0 Request processed in 167763us (172051us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545844.982526:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789545844.982780:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454969600 00000100:00100000:3.0:1789545844.982790:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454969600 00000100:00100000:3.0:1789545844.982873:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789545844.982891:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14448:x1876474454969600:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789545844.982956:0:15107:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:1.0:1789545845.003980:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14448:x1876474454969600:12345-0@lo:5:osp-pre-1-0.0 Request processed in 21081us (21781us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789545845.004000:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789545845.005818:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4eddf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14448:1876474454969600:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789545845.005846:0:14448:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1789545845.309694:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789545845.485275:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1789545845.485466:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000040:00080000:0.0:1789545845.885269:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789545846.338287:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545847.356550:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789545847.577723:0:16184:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg116-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789545848.380626:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789545848.895992:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789545848.896026:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454969728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789545848.896129:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545848.899916:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454969728 00000100:00100000:0.0:1789545848.899940:0:15111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454969728 00000100:00100000:0.0:1789545848.901259:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789545848.901283:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454969728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789545848.901346:0:15111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789545848.901485:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454969728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 210us (5356us total) trans 0 rc 0/0 00000100:00080000:2.0:1789545848.901878:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789545848.902814:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789545848.903909:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454969728:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789545849.407772:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545849.917996:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454970240:0@lo:400:kworker.0 00000100:00100000:2.0:1789545849.918072:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545849.918146:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789545849.918154:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6de5819a-62ff-4f85-af03-c287b54b27c1:3311:1876474454969856:0@lo:400:kworker.0 00000100:00100000:2.0:1789545849.918185:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545849.918224:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876474454970368:0@lo:400:kworker.0 00000100:00100000:2.0:1789545849.918249:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545849.918278:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454970240 00000100:00100000:2.0:1789545849.918285:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454970240 00000100:00100000:2.0:1789545849.918324:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454970368 00000100:00100000:2.0:1789545849.918327:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454970368 00000100:00100000:2.0:1789545849.918355:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789545849.918384:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454970240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545849.918437:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454970240:12345-0@lo:400:kworker.0 Request processed in 54us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545849.918444:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789545849.918462:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789545849.918468:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876474454970368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545849.918510:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876474454970368:12345-0@lo:400:kworker.0 Request processed in 42us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545849.918516:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789545849.918535:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454969856 00000100:00100000:2.0:1789545849.918539:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454969856 00000100:00100000:2.0:1789545849.918577:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789545849.918583:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd93cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+19:3311:x1876474454969856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545849.918613:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd93cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+19:3311:x1876474454969856:12345-0@lo:400:kworker.0 Request processed in 30us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545849.918618:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1789545849.918649:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789545849.918677:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6de5819a-62ff-4f85-af03-c287b54b27c1:3311:1876474454969856:0@lo:400:kworker.0 00010000:00080000:2.0:1789545849.918689:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be4f43800 x1876474454970368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545849.918700:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876474454970368:0@lo:400:kworker.0 00010000:00080000:2.0:1789545849.918709:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be4f43480 x1876474454970240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789545849.918717:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454970240:0@lo:400:kworker.0 00000100:00100000:0.0:1789545849.918881:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454970112:0@lo:400:kworker.0 00000100:00100000:0.0:1789545849.918915:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545849.918954:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454970624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789545849.918977:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545849.918997:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789545849.919002:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454969984:0@lo:400:kworker.0 00000100:00100000:0.0:1789545849.919023:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545849.919041:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876474454970496:0@lo:400:kworker.0 00000100:00100000:0.0:1789545849.919064:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545849.919093:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454970624 00000100:00100000:0.0:1789545849.919097:0:15111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454970624 00000100:00100000:0.0:1789545849.919143:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789545849.919151:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454970624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789545849.919180:0:15111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789545849.919219:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454970624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545849.919225:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789545849.919255:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789545849.919271:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454970624:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789545849.919284:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789545849.919292:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454970496 00000100:00100000:0.0:1789545849.919294:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454970496 00000100:00100000:0.0:1789545849.919322:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789545849.919328:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876474454970496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545849.919395:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876474454970496:12345-0@lo:400:kworker.0 Request processed in 66us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545849.919400:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789545849.919428:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994be4f42680 x1876474454970496/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789545865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789545849.919445:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876474454970496:0@lo:400:kworker.0 00000100:00080000:0.0:1789545849.919461:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789545849.919734:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454970112 00000100:00100000:2.0:1789545849.919739:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454970112 00000100:00100000:2.0:1789545849.919774:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454969984 00000100:00100000:2.0:1789545849.919777:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454969984 00000100:00100000:2.0:1789545849.919796:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789545849.919802:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454970112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545849.919843:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454970112:12345-0@lo:400:kworker.0 Request processed in 41us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545849.919848:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789545849.919860:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789545849.919866:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454969984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545849.919894:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454969984:12345-0@lo:400:kworker.0 Request processed in 28us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545849.919907:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789545849.919934:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454969984:0@lo:400:kworker.0 00000100:00100000:2.0:1789545849.919944:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454970112:0@lo:400:kworker.0 00000100:00100000:3.0:1789545850.251541:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545850.251649:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438196224 00000100:00100000:0.0:1789545850.251660:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438196224 00000100:00100000:0.0:1789545850.251712:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 76 00000100:00100000:0.0:1789545850.251721:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd93ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2357:x1876474438196224:12345-192.168.201.16@tcp:250:mount.lustre.0 00010000:00080000:0.0:1789545850.251752:0:14416:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from cf44d924-2261-46de-bbbd-7daed3b9d29d@192.168.201.16@tcp t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:0.0:1789545850.251782:0:14416:0:(genops.c:1384:class_connect()) connect: client cf44d924-2261-46de-bbbd-7daed3b9d29d, cookie 0x64919c0f856c1994 00000100:00080000:0.0:1789545850.251924:0:14416:0:(import.c:65:import_set_state_nolock()) ffff994ac198b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789545850.252003:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd93ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf44d924-2261-46de-bbbd-7daed3b9d29d+5:2357:x1876474438196224:12345-192.168.201.16@tcp:250:mount.lustre.0 Request processed in 281us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545850.252011:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 76 00000100:00100000:0.0:1789545850.254617:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545850.254726:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438196352 00000100:00100000:2.0:1789545850.254737:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438196352 00000100:00100000:2.0:1789545850.254796:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 77 00000100:00100000:2.0:1789545850.254806:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd93cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf44d924-2261-46de-bbbd-7daed3b9d29d+5:13772:x1876474438196352:12345-192.168.201.16@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789545850.254822:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545850.254840:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994ac2be9000/0x64919c0f856c199b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de57d0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545850.254868:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994ac2be9000/0x64919c0f856c199b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de57d0 expref: 6 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545850.254879:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994ac2be9000/0x64919c0f856c199b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de57d0 expref: 6 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545850.254889:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994ac2be9000, rc 0) 00000100:00100000:2.0:1789545850.254942:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd93cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf44d924-2261-46de-bbbd-7daed3b9d29d+6:13772:x1876474438196352:12345-192.168.201.16@tcp:101:mount.lustre.0 Request processed in 138us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545850.254949:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 77 00000100:00100000:3.0:1789545850.263638:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545850.263785:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438196480 00000100:00100000:2.0:1789545850.263797:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438196480 00000100:00100000:2.0:1789545850.263862:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 78 00000100:00100000:2.0:1789545850.263874:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd93ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf44d924-2261-46de-bbbd-7daed3b9d29d+6:13772:x1876474438196480:12345-192.168.201.16@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789545850.264323:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd93ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf44d924-2261-46de-bbbd-7daed3b9d29d+6:13772:x1876474438196480:12345-192.168.201.16@tcp:501:mount.lustre.0 Request processed in 450us (694us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789545850.264341:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 78 00000100:00100000:3.0:1789545850.269449:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545850.269558:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438196608 00000100:00100000:1.0:1789545850.269569:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438196608 00000100:00100000:1.0:1789545850.269629:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 79 00000100:00100000:1.0:1789545850.269640:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd93cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf44d924-2261-46de-bbbd-7daed3b9d29d+6:13772:x1876474438196608:12345-192.168.201.16@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789545850.269657:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545850.269688:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc8ba8a00/0x64919c0f856c19a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de57d7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545850.269718:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc8ba8a00/0x64919c0f856c19a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de57d7 expref: 7 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545850.269730:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc8ba8a00/0x64919c0f856c19a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de57d7 expref: 7 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545850.269741:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba8a00, rc 0) 00000100:00100000:1.0:1789545850.269808:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd93cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf44d924-2261-46de-bbbd-7daed3b9d29d+7:13772:x1876474438196608:12345-192.168.201.16@tcp:101:mount.lustre.0 Request processed in 169us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545850.269816:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 79 00000100:00100000:1.0:1789545850.286953:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545850.287045:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438196736 00000100:00100000:0.0:1789545850.287055:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438196736 00000100:00100000:0.0:1789545850.287100:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 80 00000100:00100000:0.0:1789545850.287107:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd93cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf44d924-2261-46de-bbbd-7daed3b9d29d+7:13772:x1876474438196736:12345-192.168.201.16@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789545850.290430:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd93cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf44d924-2261-46de-bbbd-7daed3b9d29d+8:13772:x1876474438196736:12345-192.168.201.16@tcp:501:mount.lustre.0 Request processed in 3309us (3475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545850.290446:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 80 00000100:00100000:3.0:1789545850.299770:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545850.299890:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438196864 00000100:00100000:2.0:1789545850.299903:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438196864 00000100:00100000:2.0:1789545850.299962:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 81 00000100:00100000:2.0:1789545850.299971:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd93cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf44d924-2261-46de-bbbd-7daed3b9d29d+8:13772:x1876474438196864:12345-192.168.201.16@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789545850.300430:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd93cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf44d924-2261-46de-bbbd-7daed3b9d29d+8:13772:x1876474438196864:12345-192.168.201.16@tcp:503:mount.lustre.0 Request processed in 457us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545850.300439:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 81 00000100:00100000:3.0:1789545850.312474:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545850.312907:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438196992 00000100:00100000:2.0:1789545850.312917:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438196992 00000100:00100000:2.0:1789545850.313035:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 82 00000100:00100000:2.0:1789545850.313047:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd93ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf44d924-2261-46de-bbbd-7daed3b9d29d+8:13790:x1876474438196992:12345-192.168.201.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789545850.313686:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd93ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf44d924-2261-46de-bbbd-7daed3b9d29d+8:13790:x1876474438196992:12345-192.168.201.16@tcp:502:llog_process_th.0 Request processed in 638us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545850.313695:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 82 00000100:00100000:0.0:1789545850.342619:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545850.342731:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438197120 00000100:00100000:1.0:1789545850.342742:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438197120 00000100:00100000:1.0:1789545850.342804:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 83 00000100:00100000:1.0:1789545850.342814:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd93cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf44d924-2261-46de-bbbd-7daed3b9d29d+8:13790:x1876474438197120:12345-192.168.201.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789545850.343099:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd93cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf44d924-2261-46de-bbbd-7daed3b9d29d+8:13790:x1876474438197120:12345-192.168.201.16@tcp:502:llog_process_th.0 Request processed in 285us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545850.343107:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 83 00000100:00100000:3.0:1789545850.354152:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545850.354538:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438197248 00000100:00100000:2.0:1789545850.354549:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438197248 00000100:00100000:2.0:1789545850.354616:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 84 00000100:00100000:2.0:1789545850.354628:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd93cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf44d924-2261-46de-bbbd-7daed3b9d29d+8:13772:x1876474438197248:12345-192.168.201.16@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789545850.354648:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545850.354670:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994ac2be9e00/0x64919c0f856c19a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5801 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545850.354732:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994ac2be9e00/0x64919c0f856c19a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5801 expref: 9 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545850.354745:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994ac2be9e00/0x64919c0f856c19a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5801 expref: 9 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545850.354754:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994ac2be9e00, rc 0) 00000100:00100000:2.0:1789545850.354821:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd93cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf44d924-2261-46de-bbbd-7daed3b9d29d+9:13772:x1876474438197248:12345-192.168.201.16@tcp:101:mount.lustre.0 Request processed in 196us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545850.354828:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 84 00000100:00100000:3.0:1789545850.361222:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545850.361520:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438197376 00000100:00100000:2.0:1789545850.361532:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438197376 00000100:00100000:2.0:1789545850.361596:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 85 00000100:00100000:2.0:1789545850.361608:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd93cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf44d924-2261-46de-bbbd-7daed3b9d29d+9:13772:x1876474438197376:12345-192.168.201.16@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789545850.361633:0:14418:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789545850.361658:0:14418:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789545850.361662:0:14418:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789545850.361665:0:14418:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789545850.361668:0:14418:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1789545850.365962:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd93cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf44d924-2261-46de-bbbd-7daed3b9d29d+9:13772:x1876474438197376:12345-192.168.201.16@tcp:256:mount.lustre.0 Request processed in 4345us (4740us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545850.365978:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 85 00000100:00100000:3.0:1789545850.370884:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545850.371082:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438197504 00000100:00100000:1.0:1789545850.371094:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438197504 00000100:00100000:1.0:1789545850.371274:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 86 00000100:00100000:1.0:1789545850.371286:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd93cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf44d924-2261-46de-bbbd-7daed3b9d29d+9:13772:x1876474438197504:12345-192.168.201.16@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789545850.371303:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545850.371322:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc8ba9200/0x64919c0f856c19b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5808 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545850.371410:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc8ba9200/0x64919c0f856c19b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5808 expref: 10 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545850.371423:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc8ba9200/0x64919c0f856c19b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5808 expref: 10 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545850.371433:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba9200, rc 0) 00000100:00100000:1.0:1789545850.371509:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd93cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf44d924-2261-46de-bbbd-7daed3b9d29d+10:13772:x1876474438197504:12345-192.168.201.16@tcp:101:mount.lustre.0 Request processed in 225us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545850.371518:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 86 00000100:00100000:3.0:1789545850.374475:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545850.374638:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438197632 00000100:00100000:2.0:1789545850.374648:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438197632 00000100:00100000:2.0:1789545850.374717:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 87 00000100:00100000:2.0:1789545850.374729:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd93ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf44d924-2261-46de-bbbd-7daed3b9d29d+10:13772:x1876474438197632:12345-192.168.201.16@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789545850.375178:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd93ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf44d924-2261-46de-bbbd-7daed3b9d29d+10:13772:x1876474438197632:12345-192.168.201.16@tcp:501:mount.lustre.0 Request processed in 450us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545850.375186:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 87 00000100:00100000:2.0:1789545850.377627:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545850.377704:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438197760 00000100:00100000:0.0:1789545850.377723:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438197760 00000100:00100000:0.0:1789545850.377777:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 88 00000100:00100000:0.0:1789545850.377787:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd93cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf44d924-2261-46de-bbbd-7daed3b9d29d+10:13772:x1876474438197760:12345-192.168.201.16@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789545850.378235:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd93cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf44d924-2261-46de-bbbd-7daed3b9d29d+10:13772:x1876474438197760:12345-192.168.201.16@tcp:503:mount.lustre.0 Request processed in 447us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545850.378255:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 88 00000100:00100000:3.0:1789545850.382083:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545850.382160:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438197888 00000100:00100000:0.0:1789545850.382169:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438197888 00000100:00100000:0.0:1789545850.382231:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 89 00000100:00100000:0.0:1789545850.382241:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bd93cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf44d924-2261-46de-bbbd-7daed3b9d29d+10:13792:x1876474438197888:12345-192.168.201.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789545850.383397:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bd93cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf44d924-2261-46de-bbbd-7daed3b9d29d+10:13792:x1876474438197888:12345-192.168.201.16@tcp:502:llog_process_th.0 Request processed in 1150us (1316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545850.383410:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 89 00000100:00100000:3.0:1789545850.393421:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545850.393569:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438198016 00000100:00100000:2.0:1789545850.393581:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438198016 00000100:00100000:2.0:1789545850.393637:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 90 00000100:00100000:2.0:1789545850.393647:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf58f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf44d924-2261-46de-bbbd-7daed3b9d29d+10:13792:x1876474438198016:12345-192.168.201.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789545850.393920:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf58f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf44d924-2261-46de-bbbd-7daed3b9d29d+10:13792:x1876474438198016:12345-192.168.201.16@tcp:502:llog_process_th.0 Request processed in 273us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545850.393938:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 90 00000100:00100000:1.0:1789545850.411084:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545850.411578:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438198144 00000100:00100000:2.0:1789545850.411591:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438198144 00000100:00100000:2.0:1789545850.411648:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 4 00000100:00100000:2.0:1789545850.411658:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2357:x1876474438198144:12345-192.168.201.16@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789545850.411696:0:14424:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 84de17c6-8992-45bc-9c05-8b5bb276e0bb@192.168.201.16@tcp t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:2.0:1789545850.411771:0:14424:0:(genops.c:1384:class_connect()) connect: client 84de17c6-8992-45bc-9c05-8b5bb276e0bb, cookie 0x64919c0f856c19b7 00000004:00100000:2.0:1789545850.411805:0:14424:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1789545850.411811:0:14424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:0.0:1789545850.429719:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789545850.469559:0:14424:0:(import.c:65:import_set_state_nolock()) ffff994ac1989800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789545850.469696:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+6:2357:x1876474438198144:12345-192.168.201.16@tcp:38:mount.lustre.0 Request processed in 58037us (58621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545850.469716:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 4 00000100:00100000:3.0:1789545850.474202:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545850.474248:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545850.474456:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438198272 00000100:00100000:2.0:1789545850.474467:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438198272 00000100:00100000:2.0:1789545850.474532:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438198400 00000100:00100000:2.0:1789545850.474535:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438198400 00000100:00100000:2.0:1789545850.474562:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 5 00000100:00100000:2.0:1789545850.474572:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+7:0:x1876474438198272:12345-192.168.201.16@tcp:41:mount.lustre.0 00000100:00080000:3.0:1789545850.474577:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:2.0:1789545850.474637:0:14425:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789545850.474741:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+7:0:x1876474438198272:12345-192.168.201.16@tcp:41:mount.lustre.0 Request processed in 171us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545850.474749:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 5 00000100:00100000:2.0:1789545850.474770:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 6 00000100:00100000:2.0:1789545850.474776:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+6:13772:x1876474438198400:12345-192.168.201.16@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789545850.474787:0:14425:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789545850.474807:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+6:13772:x1876474438198400:12345-192.168.201.16@tcp:41:mount.lustre.0 Request processed in 32us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545850.474813:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 6 00000100:00100000:3.0:1789545850.478208:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545850.478789:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438198528 00000100:00100000:0.0:1789545850.478800:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438198528 00000100:00100000:0.0:1789545850.478870:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7 00000100:00100000:0.0:1789545850.478882:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+6:13772:x1876474438198528:12345-192.168.201.16@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789545850.478989:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+6:13772:x1876474438198528:12345-192.168.201.16@tcp:40:mount.lustre.0 Request processed in 109us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545850.478998:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7 00000100:00100000:3.0:1789545850.482303:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545850.482697:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438198912 00000100:00100000:2.0:1789545850.482708:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438198912 00000100:00100000:2.0:1789545850.482808:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 0 00000100:00100000:2.0:1789545850.482819:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+6:13772:x1876474438198912:12345-192.168.201.16@tcp:33:mount.lustre.0 00000100:00100000:2.0:1789545850.483089:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545850.483135:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545850.483163:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438198656 00000100:00100000:2.0:1789545850.483168:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438198656 00000100:00100000:2.0:1789545850.483189:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438198784 00000100:00100000:2.0:1789545850.483192:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438198784 00000100:00100000:2.0:1789545850.483208:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8 00000100:00100000:2.0:1789545850.483213:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1876474438198656:12345-192.168.201.16@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789545850.483242:0:15109:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 84de17c6-8992-45bc-9c05-8b5bb276e0bb@192.168.201.16@tcp t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:2.0:1789545850.483271:0:15109:0:(genops.c:1384:class_connect()) connect: client 84de17c6-8992-45bc-9c05-8b5bb276e0bb, cookie 0x64919c0f856c19be 00002000:00100000:2.0:1789545850.483284:0:15109:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 84de17c6-8992-45bc-9c05-8b5bb276e0bb/ffff994ac2025800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789545850.483324:0:15109:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789545850.483717:0:15109:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789545850.483754:0:15109:0:(import.c:65:import_set_state_nolock()) ffff994ac2023800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789545850.483823:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+6:2357:x1876474438198656:12345-192.168.201.16@tcp:8:mount.lustre.0 Request processed in 608us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545850.483831:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8 00000100:00100000:2.0:1789545850.483853:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9 00000100:00100000:2.0:1789545850.483858:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1876474438198784:12345-192.168.201.16@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789545850.483876:0:15109:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 84de17c6-8992-45bc-9c05-8b5bb276e0bb@192.168.201.16@tcp t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:2.0:1789545850.483895:0:15109:0:(genops.c:1384:class_connect()) connect: client 84de17c6-8992-45bc-9c05-8b5bb276e0bb, cookie 0x64919c0f856c19c5 00002000:00100000:2.0:1789545850.483901:0:15109:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 84de17c6-8992-45bc-9c05-8b5bb276e0bb/ffff994ac2021800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789545850.483908:0:15109:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789545850.484198:0:15109:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789545850.484216:0:15109:0:(import.c:65:import_set_state_nolock()) ffff994ac2024800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789545850.484242:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+6:2357:x1876474438198784:12345-192.168.201.16@tcp:8:mount.lustre.0 Request processed in 382us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545850.484249:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9 00000004:00080000:3.0:1789545850.487041:0:14426:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4150us 00000004:00200000:3.0:1789545850.496856:0:14426:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789545850.497000:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+6:13772:x1876474438198912:12345-192.168.201.16@tcp:33:mount.lustre.0 Request processed in 14177us (14703us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545850.497017:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 0 00000100:00100000:2.0:1789545850.725491:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545850.725797:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438199040 00000100:00100000:0.0:1789545850.725809:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438199040 00000100:00100000:0.0:1789545850.725883:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8 00000100:00100000:0.0:1789545850.725894:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+6:13813:x1876474438199040:12345-192.168.201.16@tcp:101:mkdir.0 00010000:00010000:0.0:1789545850.725916:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545850.725959:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c19cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5832 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545850.726026:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c19d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545850.726039:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c19d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545850.726052:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c19d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789545850.726089:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789545850.726093:0:14423:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789545850.726142:0:14423:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c19d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545850.726174:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7c00/0x64919c0f856c19cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5832 expref: 8 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545850.726345:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c19d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5832 expref: 7 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545850.726354:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:0.0:1789545850.726406:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789545850.726411:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb6200, rc 0) 00000100:00100000:0.0:1789545850.726485:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+7:13813:x1876474438199040:12345-192.168.201.16@tcp:101:mkdir.0 Request processed in 592us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545850.726493:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8 00010000:00010000:2.0:1789545851.453269:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789545852.103928:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 84de17c6-8992-45bc-9c05-8b5bb276e0bb 00010000:00010000:0.0:1789545852.477497:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789545852.796801:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545852.797019:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438199168 00000100:00100000:0.0:1789545852.797035:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438199168 00000100:00100000:0.0:1789545852.797177:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9 00000100:00100000:0.0:1789545852.797192:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+7:13866:x1876474438199168:12345-192.168.201.16@tcp:41:lfs.0 00000004:00000024:0.0:1789545852.797255:0:14425:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789545852.797430:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+7:13866:x1876474438199168:12345-192.168.201.16@tcp:41:lfs.0 Request processed in 241us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545852.797438:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9 00000100:00080000:3.0:1789545852.798136:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789545852.809519:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545852.810056:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438199296 00000100:00100000:0.0:1789545852.810070:0:15111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438199296 00000100:00100000:0.0:1789545852.810194:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 5 00000100:00100000:0.0:1789545852.810211:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:84de17c6-8992-45bc-9c05-8b5bb276e0bb+5:13866:x1876474438199296:12345-192.168.201.16@tcp:13:lfs.0 00002000:00000024:0.0:1789545852.810272:0:15111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789545852.810435:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:84de17c6-8992-45bc-9c05-8b5bb276e0bb+5:13866:x1876474438199296:12345-192.168.201.16@tcp:13:lfs.0 Request processed in 229us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545852.810444:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 5 00000100:00080000:3.0:1789545852.810540:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789545852.818459:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545852.819217:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438199424 00000100:00100000:0.0:1789545852.819232:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438199424 00000100:00100000:0.0:1789545852.819333:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 6 00000100:00100000:0.0:1789545852.819349:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:84de17c6-8992-45bc-9c05-8b5bb276e0bb+6:13866:x1876474438199424:12345-192.168.201.16@tcp:13:lfs.0 00002000:00000024:0.0:1789545852.819436:0:15112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789545852.819578:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789545852.819902:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:84de17c6-8992-45bc-9c05-8b5bb276e0bb+6:13866:x1876474438199424:12345-192.168.201.16@tcp:13:lfs.0 Request processed in 555us (1455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545852.819911:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 6 00000100:00100000:2.0:1789545853.093599:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545853.093724:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438199552 00000100:00100000:0.0:1789545853.093758:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438199552 00000100:00100000:0.0:1789545853.093838:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 91 00000100:00100000:0.0:1789545853.093851:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf58f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf44d924-2261-46de-bbbd-7daed3b9d29d+10:13900:x1876474438199552:12345-192.168.201.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789545853.093875:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545853.093899:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994be4eb7c00/0x64919c0f856c19da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5839 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545853.093937:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994be4eb7c00/0x64919c0f856c19da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5839 expref: 11 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545853.093950:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994be4eb7c00/0x64919c0f856c19da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5839 expref: 11 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545853.093961:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb7c00, rc 0) 00000100:00100000:0.0:1789545853.094052:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf58f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf44d924-2261-46de-bbbd-7daed3b9d29d+11:13900:x1876474438199552:12345-192.168.201.16@tcp:101:mount.lustre.0 Request processed in 202us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545853.094060:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 91 00000100:00100000:2.0:1789545853.108162:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545853.108414:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438199680 00000100:00100000:0.0:1789545853.108430:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438199680 00000100:00100000:0.0:1789545853.108679:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 92 00000100:00100000:0.0:1789545853.108692:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf58d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf44d924-2261-46de-bbbd-7daed3b9d29d+11:13900:x1876474438199680:12345-192.168.201.16@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789545853.109946:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf58d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf44d924-2261-46de-bbbd-7daed3b9d29d+11:13900:x1876474438199680:12345-192.168.201.16@tcp:501:mount.lustre.0 Request processed in 1248us (1792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545853.109960:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 92 00000100:00100000:1.0:1789545853.119165:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545853.120684:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438199808 00000100:00100000:2.0:1789545853.120706:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438199808 00000100:00100000:2.0:1789545853.120861:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 93 00000100:00100000:2.0:1789545853.120886:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf58e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf44d924-2261-46de-bbbd-7daed3b9d29d+11:13900:x1876474438199808:12345-192.168.201.16@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789545853.121263:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf58e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf44d924-2261-46de-bbbd-7daed3b9d29d+11:13900:x1876474438199808:12345-192.168.201.16@tcp:503:mount.lustre.0 Request processed in 388us (2113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545853.121272:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 93 00000100:00100000:2.0:1789545853.134054:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545853.134391:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438199936 00000100:00100000:0.0:1789545853.134407:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438199936 00000100:00100000:0.0:1789545853.134486:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 94 00000100:00100000:0.0:1789545853.134499:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf58dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf44d924-2261-46de-bbbd-7daed3b9d29d+11:13906:x1876474438199936:12345-192.168.201.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789545853.135288:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf58dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf44d924-2261-46de-bbbd-7daed3b9d29d+11:13906:x1876474438199936:12345-192.168.201.16@tcp:502:llog_process_th.0 Request processed in 785us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545853.135300:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 94 00000100:00100000:3.0:1789545853.160412:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545853.160594:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438200064 00000100:00100000:2.0:1789545853.160608:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438200064 00000100:00100000:2.0:1789545853.160749:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 95 00000100:00100000:2.0:1789545853.160764:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf58c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf44d924-2261-46de-bbbd-7daed3b9d29d+11:13906:x1876474438200064:12345-192.168.201.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789545853.161195:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf58c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf44d924-2261-46de-bbbd-7daed3b9d29d+11:13906:x1876474438200064:12345-192.168.201.16@tcp:502:llog_process_th.0 Request processed in 433us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545853.161205:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 95 00000100:00100000:0.0:1789545853.169768:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545853.179946:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438200192 00000100:00100000:1.0:1789545853.179970:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438200192 00000100:00100000:1.0:1789545853.180067:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 96 00000100:00100000:1.0:1789545853.180092:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf58f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf44d924-2261-46de-bbbd-7daed3b9d29d+11:13900:x1876474438200192:12345-192.168.201.16@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789545853.180115:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545853.180140:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc8ba9600/0x64919c0f856c19e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5863 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545853.180179:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc8ba9600/0x64919c0f856c19e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5863 expref: 12 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545853.180192:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc8ba9600/0x64919c0f856c19e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5863 expref: 12 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545853.180230:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba9600, rc 0) 00000100:00100000:1.0:1789545853.180328:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf58f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf44d924-2261-46de-bbbd-7daed3b9d29d+12:13900:x1876474438200192:12345-192.168.201.16@tcp:101:mount.lustre.0 Request processed in 239us (10577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545853.180337:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 96 00000100:00100000:3.0:1789545853.184416:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545853.184508:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438200320 00000100:00100000:0.0:1789545853.184522:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438200320 00000100:00100000:0.0:1789545853.184589:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 97 00000100:00100000:0.0:1789545853.184600:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf58fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf44d924-2261-46de-bbbd-7daed3b9d29d+12:13900:x1876474438200320:12345-192.168.201.16@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789545853.184634:0:14416:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789545853.184681:0:14416:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789545853.184686:0:14416:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789545853.184690:0:14416:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789545853.184693:0:14416:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1789545853.186444:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf58fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf44d924-2261-46de-bbbd-7daed3b9d29d+12:13900:x1876474438200320:12345-192.168.201.16@tcp:256:mount.lustre.0 Request processed in 1831us (2030us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545853.186462:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 97 00000100:00100000:3.0:1789545853.190541:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545853.190653:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438200448 00000100:00100000:0.0:1789545853.190677:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438200448 00000100:00100000:0.0:1789545853.190750:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 98 00000100:00100000:0.0:1789545853.190763:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf58cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf44d924-2261-46de-bbbd-7daed3b9d29d+12:13900:x1876474438200448:12345-192.168.201.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789545853.190789:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545853.190815:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994be4eb7a00/0x64919c0f856c19e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de586a expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545853.190850:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994be4eb7a00/0x64919c0f856c19e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de586a expref: 13 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545853.190862:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994be4eb7a00/0x64919c0f856c19e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de586a expref: 13 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545853.190905:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb7a00, rc 0) 00000100:00100000:0.0:1789545853.190994:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf58cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf44d924-2261-46de-bbbd-7daed3b9d29d+13:13900:x1876474438200448:12345-192.168.201.16@tcp:101:mount.lustre.0 Request processed in 234us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545853.191003:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 98 00000100:00100000:0.0:1789545853.195316:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545853.195508:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438200576 00000100:00100000:2.0:1789545853.195522:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438200576 00000100:00100000:2.0:1789545853.195596:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 99 00000100:00100000:2.0:1789545853.195609:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf58e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf44d924-2261-46de-bbbd-7daed3b9d29d+13:13900:x1876474438200576:12345-192.168.201.16@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789545853.196330:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf58e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf44d924-2261-46de-bbbd-7daed3b9d29d+13:13900:x1876474438200576:12345-192.168.201.16@tcp:501:mount.lustre.0 Request processed in 718us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545853.196341:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 99 00000100:00100000:0.0:1789545853.199484:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545853.199696:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438200704 00000100:00100000:3.0:1789545853.199710:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438200704 00000100:00100000:3.0:1789545853.199791:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 100 00000100:00100000:3.0:1789545853.199806:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf58e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf44d924-2261-46de-bbbd-7daed3b9d29d+13:13900:x1876474438200704:12345-192.168.201.16@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789545853.201067:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf58e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf44d924-2261-46de-bbbd-7daed3b9d29d+13:13900:x1876474438200704:12345-192.168.201.16@tcp:503:mount.lustre.0 Request processed in 1254us (1588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545853.201092:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 100 00000100:00100000:0.0:1789545853.205113:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545853.205407:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438200832 00000100:00100000:1.0:1789545853.205424:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438200832 00000100:00100000:1.0:1789545853.205510:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 101 00000100:00100000:1.0:1789545853.205523:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf58d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf44d924-2261-46de-bbbd-7daed3b9d29d+13:13908:x1876474438200832:12345-192.168.201.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789545853.206026:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf58d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf44d924-2261-46de-bbbd-7daed3b9d29d+13:13908:x1876474438200832:12345-192.168.201.16@tcp:502:llog_process_th.0 Request processed in 503us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545853.206036:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 101 00000100:00100000:1.0:1789545853.218473:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545853.218859:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438200960 00000100:00100000:3.0:1789545853.218884:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438200960 00000100:00100000:3.0:1789545853.218956:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 102 00000100:00100000:3.0:1789545853.218991:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf58c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf44d924-2261-46de-bbbd-7daed3b9d29d+13:13908:x1876474438200960:12345-192.168.201.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789545853.219342:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf58c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf44d924-2261-46de-bbbd-7daed3b9d29d+13:13908:x1876474438200960:12345-192.168.201.16@tcp:502:llog_process_th.0 Request processed in 353us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545853.219352:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 102 00000100:00100000:0.0:1789545853.233294:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545853.233347:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545853.233428:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545853.233460:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545853.233854:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438201088 00000100:00100000:3.0:1789545853.233879:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438201088 00000100:00100000:3.0:1789545853.233928:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438201472 00000100:00100000:3.0:1789545853.233930:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438201472 00000100:00100000:3.0:1789545853.233971:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 16 00000100:00100000:3.0:1789545853.233983:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+7:2360:x1876474438201472:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:3.0:1789545853.234101:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+7:2360:x1876474438201472:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 120us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545853.234110:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 16 00000100:00100000:3.0:1789545853.234134:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10 00000100:00100000:3.0:1789545853.234139:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2357:x1876474438201088:12345-192.168.201.16@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789545853.234172:0:14423:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from daf4bf8f-5385-4ff6-ae15-d2b9e125b22e@192.168.201.16@tcp t0 exp 0000000000000000 cur 467 last 0 00000020:00000080:3.0:1789545853.234223:0:14423:0:(genops.c:1384:class_connect()) connect: client daf4bf8f-5385-4ff6-ae15-d2b9e125b22e, cookie 0x64919c0f856c19ef 00000004:00100000:3.0:1789545853.234265:0:14423:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789545853.234463:0:14423:0:(import.c:65:import_set_state_nolock()) ffff994be4c99800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789545853.234502:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+6:2357:x1876474438201088:12345-192.168.201.16@tcp:38:mount.lustre.0 Request processed in 360us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545853.234509:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10 00000100:00100000:2.0:1789545853.236044:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438201600 00000100:00100000:2.0:1789545853.236063:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438201600 00000100:00100000:2.0:1789545853.236156:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438201728 00000100:00100000:2.0:1789545853.236160:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438201728 00000100:00100000:2.0:1789545853.236199:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 4 00000100:00100000:2.0:1789545853.236210:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+5:2360:x1876474438201600:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545853.236316:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+5:2360:x1876474438201600:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 109us (2970us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545853.236338:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 4 00000100:00100000:2.0:1789545853.236354:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 5 00000100:00100000:2.0:1789545853.236393:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+6:2360:x1876474438201728:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545853.236421:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+6:2360:x1876474438201728:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 62us (2961us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545853.236428:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 5 00000100:00100000:0.0:1789545853.248691:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545853.248748:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545853.249272:0:15758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438201344 00000100:00100000:1.0:1789545853.249286:0:15758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438201344 00000100:00100000:1.0:1789545853.249420:0:15758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438201216 00000100:00100000:1.0:1789545853.249424:0:15758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438201216 00000100:00100000:1.0:1789545853.249455:0:15758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11 00000100:00100000:1.0:1789545853.249467:0:15758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+7:13900:x1876474438201344:12345-192.168.201.16@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789545853.249534:0:15758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789545853.249631:0:15758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+7:13900:x1876474438201344:12345-192.168.201.16@tcp:41:mount.lustre.0 Request processed in 166us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545853.249639:0:15758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11 00000100:00100000:3.0:1789545853.249906:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12 00000100:00100000:3.0:1789545853.249918:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+7:0:x1876474438201216:12345-192.168.201.16@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789545853.249955:0:14423:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789545853.249996:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+7:0:x1876474438201216:12345-192.168.201.16@tcp:41:mount.lustre.0 Request processed in 81us (1246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545853.250003:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12 00000100:00080000:0.0:1789545853.250420:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789545853.253096:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545853.254166:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438201856 00000100:00100000:3.0:1789545853.254184:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438201856 00000100:00100000:3.0:1789545853.254271:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 13 00000100:00100000:3.0:1789545853.254284:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+6:13900:x1876474438201856:12345-192.168.201.16@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789545853.254460:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+6:13900:x1876474438201856:12345-192.168.201.16@tcp:40:mount.lustre.0 Request processed in 177us (1388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545853.254470:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 13 00000100:00100000:2.0:1789545853.262042:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545853.262099:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545853.262238:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545853.262343:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438202240 00000100:00100000:0.0:1789545853.262380:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438202240 00000100:00100000:0.0:1789545853.262443:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1 00000100:00100000:0.0:1789545853.262456:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+6:13900:x1876474438202240:12345-192.168.201.16@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789545853.262578:0:14427:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789545853.262697:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+6:13900:x1876474438202240:12345-192.168.201.16@tcp:33:mount.lustre.0 Request processed in 243us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545853.262706:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1 00000100:00100000:1.0:1789545853.267909:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438201984 00000100:00100000:1.0:1789545853.267937:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438201984 00000100:00100000:1.0:1789545853.268030:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438202112 00000100:00100000:1.0:1789545853.268035:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438202112 00000100:00100000:1.0:1789545853.268088:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10 00000100:00100000:1.0:1789545853.268100:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1876474438201984:12345-192.168.201.16@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789545853.268151:0:15109:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from daf4bf8f-5385-4ff6-ae15-d2b9e125b22e@192.168.201.16@tcp t0 exp 0000000000000000 cur 467 last 0 00000020:00000080:1.0:1789545853.268192:0:15109:0:(genops.c:1384:class_connect()) connect: client daf4bf8f-5385-4ff6-ae15-d2b9e125b22e, cookie 0x64919c0f856c19f6 00002000:00100000:1.0:1789545853.268209:0:15109:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli daf4bf8f-5385-4ff6-ae15-d2b9e125b22e/ffff994ac27f4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789545853.268223:0:15109:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789545853.268612:0:15109:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:2.0:1789545853.268919:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11 00000100:00100000:2.0:1789545853.268929:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1876474438202112:12345-192.168.201.16@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789545853.268957:0:15110:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from daf4bf8f-5385-4ff6-ae15-d2b9e125b22e@192.168.201.16@tcp t0 exp 0000000000000000 cur 467 last 0 00000020:00000080:2.0:1789545853.268984:0:15110:0:(genops.c:1384:class_connect()) connect: client daf4bf8f-5385-4ff6-ae15-d2b9e125b22e, cookie 0x64919c0f856c19fd 00002000:00100000:2.0:1789545853.268992:0:15110:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli daf4bf8f-5385-4ff6-ae15-d2b9e125b22e/ffff994ac2027000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789545853.269000:0:15110:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789545853.269096:0:15110:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789545853.269128:0:15110:0:(import.c:65:import_set_state_nolock()) ffff994ac2023000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789545853.269229:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+6:2357:x1876474438202112:12345-192.168.201.16@tcp:8:mount.lustre.0 Request processed in 298us (6989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545853.269238:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11 00000100:00080000:1.0:1789545853.269412:0:15109:0:(import.c:65:import_set_state_nolock()) ffff994ac27f5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789545853.269602:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+6:2357:x1876474438201984:12345-192.168.201.16@tcp:8:mount.lustre.0 Request processed in 1503us (7501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545853.269610:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10 00000100:00100000:2.0:1789545853.465545:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545853.465693:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438202368 00000100:00100000:0.0:1789545853.465710:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438202368 00000100:00100000:0.0:1789545853.465799:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 14 00000100:00100000:0.0:1789545853.465813:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+6:13929:x1876474438202368:12345-192.168.201.16@tcp:101:mkdir.0 00010000:00010000:0.0:1789545853.465864:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545853.465905:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6a00/0x64919c0f856c1a04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5894 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545853.466001:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1a0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545853.466018:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1a0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545853.466034:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1a0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789545853.466103:0:14425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789545853.466108:0:14425:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789545853.466137:0:14425:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1a0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545853.466171:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6a00/0x64919c0f856c1a04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5894 expref: 8 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545853.466198:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1a0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5894 expref: 7 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545853.466209:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:0.0:1789545853.466212:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789545853.466217:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb7200, rc 0) 00000100:00100000:0.0:1789545853.466305:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+7:13929:x1876474438202368:12345-192.168.201.16@tcp:101:mkdir.0 Request processed in 496us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545853.466325:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 14 00010000:00010000:2.0:1789545853.501007:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545854.014175:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789545854.014330:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454970752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789545854.014587:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545854.014881:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454970752 00000100:00100000:0.0:1789545854.014894:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454970752 00000100:00100000:0.0:1789545854.015033:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789545854.015046:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454970752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789545854.015091:0:15112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789545854.015173:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454970752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545854.015181:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789545854.015346:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454970752:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789545854.015866:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789545854.524743:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545855.036824:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789545855.041032:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454971264:0@lo:400:kworker.0 00000100:00100000:0.0:1789545855.041141:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545855.041214:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be5193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454970880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789545855.041241:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545855.041277:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6de5819a-62ff-4f85-af03-c287b54b27c1:3313:1876474454971008:0@lo:400:kworker.0 00000100:00100000:0.0:1789545855.041309:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545855.041333:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789545855.041339:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454971136:0@lo:400:kworker.0 00000100:00100000:0.0:1789545855.041377:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545855.041420:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454970880 00000100:00100000:0.0:1789545855.041430:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454970880 00000100:00100000:0.0:1789545855.041505:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789545855.041517:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454970880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789545855.041564:0:15112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789545855.041812:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454970880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 298us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545855.041822:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789545855.041863:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454971008 00000100:00100000:0.0:1789545855.041975:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454971008 00000100:00100000:0.0:1789545855.042007:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789545855.042014:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf58d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+19:3313:x1876474454971008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545855.042063:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf58d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+19:3313:x1876474454971008:12345-0@lo:400:kworker.0 Request processed in 49us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545855.042069:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789545855.042098:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454971264 00000100:00100000:0.0:1789545855.042101:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454971264 00000100:00100000:0.0:1789545855.042124:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454971136 00000100:00100000:0.0:1789545855.042126:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454971136 00000100:00100000:0.0:1789545855.042142:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789545855.042148:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454971264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545855.042177:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454971264:12345-0@lo:400:kworker.0 Request processed in 29us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545855.042183:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789545855.042192:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789545855.042197:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454971136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545855.042219:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454971136:12345-0@lo:400:kworker.0 Request processed in 22us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545855.042225:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1789545855.042239:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789545855.042282:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454971136:0@lo:400:kworker.0 00000100:00100000:0.0:1789545855.042291:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6de5819a-62ff-4f85-af03-c287b54b27c1:3313:1876474454971008:0@lo:400:kworker.0 00000100:00100000:0.0:1789545855.042343:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454971264:0@lo:400:kworker.0 00000100:00100000:0.0:1789545855.042383:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be5193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454970880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789545855.043737:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789545855.043815:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454971520:0@lo:400:kworker.0 00000100:00100000:1.0:1789545855.043915:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545855.043959:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789545855.043966:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876474454971648:0@lo:400:kworker.0 00000100:00100000:1.0:1789545855.043989:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545855.044135:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454971520 00000100:00100000:2.0:1789545855.044146:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454971520 00000100:00100000:2.0:1789545855.044214:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454971648 00000100:00100000:2.0:1789545855.044218:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454971648 00000100:00100000:2.0:1789545855.044244:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789545855.044254:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454971520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545855.044316:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876474454971520:12345-0@lo:400:kworker.0 Request processed in 64us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545855.044324:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789545855.044343:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789545855.044350:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876474454971648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545855.044418:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876474454971648:12345-0@lo:400:kworker.0 Request processed in 68us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545855.044424:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789545855.044476:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876474454971648:0@lo:400:kworker.0 00000100:00100000:2.0:1789545855.044501:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876474454971520:0@lo:400:kworker.0 00000100:00080000:1.0:1789545855.044992:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789545855.050011:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454971392:0@lo:400:kworker.0 00000100:00100000:0.0:1789545855.050130:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545855.050752:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454971392 00000100:00100000:1.0:1789545855.050764:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454971392 00000100:00100000:1.0:1789545855.050845:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789545855.050857:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454971392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545855.051087:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876474454971392:12345-0@lo:400:kworker.0 Request processed in 232us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545855.051095:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789545855.051599:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876474454971392:0@lo:400:kworker.0 00000040:00080000:3.0:1789545855.104935:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789545855.548897:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789545855.626412:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of daf4bf8f-5385-4ff6-ae15-d2b9e125b22e 00000001:00100000:1.0:1789545855.626433:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 84de17c6-8992-45bc-9c05-8b5bb276e0bb 00000001:00100000:3.0:1789545855.635232:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 84de17c6-8992-45bc-9c05-8b5bb276e0bb 00000001:00100000:3.0:1789545855.635264:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of daf4bf8f-5385-4ff6-ae15-d2b9e125b22e 00000001:02000400:3.0:1789545856.389999:0:16387:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789545856.573748:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789545857.207398:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of daf4bf8f-5385-4ff6-ae15-d2b9e125b22e 00010000:00010000:0.0:1789545857.608788:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545858.488189:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545858.488246:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545858.488276:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545858.488310:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545858.488331:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545858.488353:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545858.488427:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545858.488463:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438202880 00000100:00100000:2.0:1789545858.488488:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438202880 00000100:00100000:2.0:1789545858.488564:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438203136 00000100:00100000:2.0:1789545858.488567:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438203136 00000100:00100000:2.0:1789545858.488586:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438202752 00000100:00100000:2.0:1789545858.488588:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438202752 00000100:00100000:2.0:1789545858.488600:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438203264 00000100:00100000:2.0:1789545858.488603:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438203264 00000100:00100000:2.0:1789545858.488620:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8 00000100:00100000:2.0:1789545858.488632:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+5:2361:x1876474438202880:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545858.488739:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+5:2361:x1876474438202880:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 108us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545858.488747:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8 00000100:00100000:2.0:1789545858.488771:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9 00000100:00100000:2.0:1789545858.488778:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+5:2361:x1876474438203136:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545858.488807:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+5:2361:x1876474438203136:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 29us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545858.488814:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9 00000100:00100000:2.0:1789545858.488828:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10 00000100:00100000:2.0:1789545858.488834:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+5:2361:x1876474438202752:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545858.488871:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+5:2361:x1876474438202752:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 38us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545858.488878:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10 00000100:00100000:2.0:1789545858.488889:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11 00000100:00100000:2.0:1789545858.488895:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+5:2361:x1876474438203264:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545858.489493:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+5:2361:x1876474438203264:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 594us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545858.489514:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11 00000100:00100000:2.0:1789545858.489560:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438202624 00000100:00100000:2.0:1789545858.489569:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438202624 00000100:00100000:2.0:1789545858.489618:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438203008 00000100:00100000:2.0:1789545858.489622:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438203008 00000100:00100000:2.0:1789545858.489649:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 20 00000100:00100000:2.0:1789545858.489657:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+6:2361:x1876474438202624:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545858.489695:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+6:2361:x1876474438202624:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 38us (1521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545858.489702:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 20 00000100:00100000:2.0:1789545858.489715:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 21 00000100:00100000:2.0:1789545858.489721:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+6:2361:x1876474438203008:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545858.489744:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+6:2361:x1876474438203008:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 22us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545858.489761:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 21 00000100:00080000:2.0:1789545858.489784:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789545858.489789:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789545858.489791:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789545858.490942:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438202496 00000100:00100000:1.0:1789545858.490959:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438202496 00000100:00100000:1.0:1789545858.491044:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 104 00000100:00100000:1.0:1789545858.491055:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf44d924-2261-46de-bbbd-7daed3b9d29d+13:2361:x1876474438202496:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545858.491134:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf44d924-2261-46de-bbbd-7daed3b9d29d+13:2361:x1876474438202496:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 81us (2822us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545858.491141:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 104 00010000:00010000:2.0:1789545858.627478:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789545859.132572:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be5192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454971776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789545859.132647:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545859.132764:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454971776 00000100:00100000:2.0:1789545859.132774:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454971776 00000100:00100000:2.0:1789545859.132844:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789545859.132855:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454971776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789545859.132892:0:15112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789545859.132946:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876474454971776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545859.132976:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789545859.133029:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be5192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876474454971776:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789545859.133091:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789545859.645600:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789545860.157896:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6de5819a-62ff-4f85-af03-c287b54b27c1:3312:1876474454971904:0@lo:400:kworker.0 00000100:00100000:3.0:1789545860.157984:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545860.158037:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876474454972416:0@lo:400:kworker.0 00000100:00100000:3.0:1789545860.158067:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545860.158095:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789545860.158101:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876474454972288:0@lo:400:kworker.0 00000100:00100000:3.0:1789545860.158122:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545860.158149:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454972160:0@lo:400:kworker.0 00000100:00100000:3.0:1789545860.158185:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545860.158219:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789545860.158225:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454972032:0@lo:400:kworker.0 00000100:00100000:3.0:1789545860.158246:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545860.158261:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be3a9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876474454972544:0@lo:400:kworker.0 00000100:00100000:3.0:1789545860.158299:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545860.160730:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454971904 00000100:00100000:3.0:1789545860.160938:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be3a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454972672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789545860.161021:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545860.161180:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454971904 00000100:00100000:0.0:1789545860.161252:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789545860.161263:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf540850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+19:3312:x1876474454971904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545860.161489:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf540850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+19:3312:x1876474454971904:12345-0@lo:400:kworker.0 Request processed in 227us (3504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545860.161498:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789545860.161681:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6de5819a-62ff-4f85-af03-c287b54b27c1:3312:1876474454971904:0@lo:400:kworker.0 00000100:00100000:2.0:1789545860.163263:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454972416 00000100:00100000:2.0:1789545860.163287:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454972416 00000100:00100000:2.0:1789545860.163352:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454972288 00000100:00100000:2.0:1789545860.163355:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454972288 00000100:00100000:2.0:1789545860.163395:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454972544 00000100:00100000:2.0:1789545860.163398:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454972544 00000100:00100000:2.0:1789545860.163416:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789545860.163425:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876474454972416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545860.163520:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876474454972416:12345-0@lo:400:kworker.0 Request processed in 95us (5451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545860.163539:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1789545860.163707:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789545860.163963:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789545860.163971:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876474454972288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545860.164006:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876474454972288:12345-0@lo:400:kworker.0 Request processed in 37us (5882us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545860.164012:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789545860.164024:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789545860.164030:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876474454972544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545860.164075:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876474454972544:12345-0@lo:400:kworker.0 Request processed in 45us (5775us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545860.164081:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789545860.164106:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454972160 00000100:00100000:2.0:1789545860.164111:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454972160 00000100:00100000:2.0:1789545860.164143:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454972032 00000100:00100000:2.0:1789545860.164159:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454972032 00000100:00100000:2.0:1789545860.164179:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789545860.164184:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454972160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545860.164229:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454972160:12345-0@lo:400:kworker.0 Request processed in 44us (6043us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545860.164235:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789545860.164247:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789545860.164253:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454972032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545860.164532:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be3a9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876474454972544:0@lo:400:kworker.0 00000100:00100000:0.0:1789545860.164555:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454972160:0@lo:400:kworker.0 00000100:00100000:2.0:1789545860.164926:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454972032:12345-0@lo:400:kworker.0 Request processed in 672us (6677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545860.164933:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789545860.164983:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454972672 00000100:00100000:2.0:1789545860.164988:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454972672 00000100:00100000:2.0:1789545860.165018:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789545860.165025:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454972672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789545860.165058:0:15112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789545860.165099:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454972672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (4078us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545860.165104:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1789545860.165120:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789545860.165152:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876474454972288:0@lo:400:kworker.0 00000100:00100000:2.0:1789545860.165164:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876474454972416:0@lo:400:kworker.0 00000100:00100000:0.0:1789545860.165932:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be3a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454972672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789545860.165977:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454972032:0@lo:400:kworker.0 00000020:00000080:3.0:1789545860.260966:0:16536:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff55fb7b80 20000000:00000080:3.0:1789545860.260989:0:16536:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff994ac187c400 uarg=0000000000000000 20000000:01000000:3.0:1789545860.261030:0:16536:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789545860.261037:0:16536:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789545860.261042:0:16536:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789545860.262117:0:16537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1789545860.262346:0:16536:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789545860.269512:0:16536:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789545860.269996:0:16536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff994ac2be8a00/0x64919c0f856c1a12 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545860.270018:0:16536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994be4eb6e00/0x64919c0f856c1709 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c1702 expref: 18 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545860.270040:0:16536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bc49d0e00/0x64919c0f856c1756 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c174f expref: 18 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545860.270046:0:16536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bc8ba8c00/0x64919c0f856c188a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c1883 expref: 18 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545860.270055:0:16536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994bc8ba9200/0x64919c0f856c19b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5808 expref: 12 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545860.270062:0:16536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994be4eb7a00/0x64919c0f856c19e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de586a expref: 12 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545860.270069:0:16536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff994ac2be8a00/0x64919c0f856c1a12 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545860.270119:0:16536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994be4eb7a00/0x64919c0f856c19e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de586a expref: 12 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545860.270137:0:16536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994be4eb7a00/0x64919c0f856c19e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de586a expref: 12 pid: 14417 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545860.270153:0:16536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be5192680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16536:1876474454972800:192.168.201.16@tcp:104: 00010000:00010000:2.0:1789545860.270317:0:16536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bc8ba9200/0x64919c0f856c19b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5808 expref: 12 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545860.270326:0:16536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994bc8ba9200/0x64919c0f856c19b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5808 expref: 12 pid: 14416 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545860.270334:0:16536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be5192a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16536:1876474454972928:192.168.201.16@tcp:104: 00010000:00010000:2.0:1789545860.270413:0:16536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bc8ba8c00/0x64919c0f856c188a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c1883 expref: 18 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545860.270422:0:16536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994bc8ba8c00/0x64919c0f856c188a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c1883 expref: 18 pid: 14417 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545860.270431:0:16536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be5193480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16536:1876474454973056:0@lo:104: 00000100:00100000:2.0:1789545860.270476:0:16536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789545860.270516:0:16536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994bc49d0e00/0x64919c0f856c1756 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c174f expref: 18 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545860.270536:0:16536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994bc49d0e00/0x64919c0f856c1756 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c174f expref: 18 pid: 14416 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545860.270544:0:16536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4eddf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16536:1876474454973184:0@lo:104: 00000100:00100000:2.0:1789545860.270564:0:16536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789545860.270590:0:16536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994be4eb6e00/0x64919c0f856c1709 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x64919c0f856c1702 expref: 18 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545860.270598:0:16536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994be4eb6e00/0x64919c0f856c1709 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x64919c0f856c1702 expref: 18 pid: 14417 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545860.270607:0:16536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c1f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16536:1876474454973312:0@lo:104: 00000100:00100000:2.0:1789545860.270632:0:16536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545860.270642:0:16536:0:(client.c:2716:ptlrpc_set_wait()) set ffff994be4c27b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789545860.270813:0:14406:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789545860.270842:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454973056 00000100:00100000:3.0:1789545860.270848:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454973056 00000100:00100000:3.0:1789545860.270887:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454973184 00000100:00100000:3.0:1789545860.270890:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454973184 00000100:00100000:3.0:1789545860.270898:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454973312 00000100:00100000:3.0:1789545860.270901:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454973312 00000100:00100000:3.0:1789545860.270912:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789545860.270919:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4edc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6de5819a-62ff-4f85-af03-c287b54b27c1+5:16536:x1876474454973056:12345-0@lo:104: 00010000:00010000:3.0:1789545860.270931:0:14406:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994be4eb6000/0x64919c0f856c1883 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c188a expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545860.270995:0:14406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789545860.271007:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4edc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6de5819a-62ff-4f85-af03-c287b54b27c1+5:16536:x1876474454973056:12345-0@lo:104: Request processed in 88us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545860.271014:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789545860.271032:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789545860.271037:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6de5819a-62ff-4f85-af03-c287b54b27c1+4:16536:x1876474454973184:12345-0@lo:104: 00010000:00010000:3.0:1789545860.271044:0:14406:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994bee11be00/0x64919c0f856c174f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c1756 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545860.271079:0:14406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789545860.271084:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6de5819a-62ff-4f85-af03-c287b54b27c1+4:16536:x1876474454973184:12345-0@lo:104: Request processed in 47us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545860.271090:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789545860.271102:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789545860.271108:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf5f2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6de5819a-62ff-4f85-af03-c287b54b27c1+3:16536:x1876474454973312:12345-0@lo:104: 00010000:00010000:3.0:1789545860.271115:0:14406:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.116@tcp lock: ffff994bee11ae00/0x64919c0f856c1702 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c1709 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545860.271141:0:14406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789545860.271145:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf5f2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6de5819a-62ff-4f85-af03-c287b54b27c1+3:16536:x1876474454973312:12345-0@lo:104: Request processed in 38us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545860.271150:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789545860.271186:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789545860.271193:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994be4eb6000/0x64919c0f856c1883 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c188a expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545860.271201:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6000 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:3.0:1789545860.271205:0:14411:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994be4eb6000/0x64919c0f856c1883 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c188a expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545860.271223:0:14411:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994be4eb6000/0x64919c0f856c1883 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c188a expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789545860.271229:0:14411:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994be4eb6000/0x64919c0f856c1883 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c188a expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789545860.271235:0:14411:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789545860.271260:0:14411:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994be4eb6000/0x64919c0f856c1883 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c188a expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545860.271266:0:14411:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789545860.271286:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994be4eb6000/0x64919c0f856c1883 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c188a expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545860.271293:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994be4eb6000/0x64919c0f856c1883 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c188a expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545860.271308:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789545860.271311:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bee11be00/0x64919c0f856c174f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c1756 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545860.271317:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bee11be00 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:3.0:1789545860.271320:0:14411:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bee11be00/0x64919c0f856c174f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c1756 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545860.271326:0:14411:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bee11be00/0x64919c0f856c174f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c1756 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789545860.271332:0:14411:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bee11be00/0x64919c0f856c174f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c1756 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789545860.271344:0:14411:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789545860.271375:0:14411:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bee11be00/0x64919c0f856c174f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c1756 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545860.271381:0:14411:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789545860.271387:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bee11be00/0x64919c0f856c174f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c1756 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545860.271393:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bee11be00/0x64919c0f856c174f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c1756 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545860.271403:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789545860.271406:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.116@tcp lock: ffff994bee11ae00/0x64919c0f856c1702 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x64919c0f856c1709 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545860.271412:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bee11ae00 already unused, calling callback (ffffffffc1d06c20) 10000000:00010000:3.0:1789545860.271415:0:14411:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.116@tcp lock: ffff994bee11ae00/0x64919c0f856c1702 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x64919c0f856c1709 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545860.271423:0:14411:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.116@tcp lock: ffff994bee11ae00/0x64919c0f856c1702 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x64919c0f856c1709 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789545860.271430:0:14411:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.116@tcp lock: ffff994bee11ae00/0x64919c0f856c1702 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x64919c0f856c1709 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789545860.271435:0:14411:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789545860.271446:0:14411:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.116@tcp lock: ffff994bee11ae00/0x64919c0f856c1702 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c1709 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545860.271452:0:14411:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789545860.271474:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.116@tcp lock: ffff994bee11ae00/0x64919c0f856c1702 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c1709 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545860.271481:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.116@tcp lock: ffff994bee11ae00/0x64919c0f856c1702 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x64919c0f856c1709 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545860.271495:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545860.271497:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545860.271498:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789545860.271511:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be3a9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6de5819a-62ff-4f85-af03-c287b54b27c1:3311:1876474454973440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789545860.271554:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545860.271577:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789545860.271583:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be3a9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6de5819a-62ff-4f85-af03-c287b54b27c1:3311:1876474454973568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789545860.271604:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545860.271631:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be3a9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6de5819a-62ff-4f85-af03-c287b54b27c1:3313:1876474454973696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789545860.271655:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545860.271683:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454973440 00000100:00100000:3.0:1789545860.271688:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454973440 00010000:00010000:3.0:1789545860.271707:0:14409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bc8ba8c00/0x64919c0f856c188a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c1883 expref: 19 pid: 14417 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545860.271726:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454973568 00000100:00100000:3.0:1789545860.271728:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454973568 00010000:00010000:3.0:1789545860.271738:0:14409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bc49d0e00/0x64919c0f856c1756 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c174f expref: 20 pid: 14416 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545860.271746:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454973696 00000100:00100000:3.0:1789545860.271748:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454973696 00010000:00010000:3.0:1789545860.271756:0:14409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994be4eb6e00/0x64919c0f856c1709 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c1702 expref: 21 pid: 14417 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545860.271781:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789545860.271787:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6de5819a-62ff-4f85-af03-c287b54b27c1+21:3311:x1876474454973440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789545860.271797:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545860.271802:0:14409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bc8ba8c00/0x64919c0f856c188a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c1883 expref: 21 pid: 14417 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545860.271810:0:14409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bc8ba8c00/0x64919c0f856c188a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c1883 expref: 21 pid: 14417 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545860.271826:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545860.271855:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6de5819a-62ff-4f85-af03-c287b54b27c1+21:3311:x1876474454973440:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545860.271862:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789545860.271877:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789545860.271883:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6de5819a-62ff-4f85-af03-c287b54b27c1+20:3311:x1876474454973568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789545860.271890:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545860.271894:0:14409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bc49d0e00/0x64919c0f856c1756 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c174f expref: 20 pid: 14416 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545860.271902:0:14409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bc49d0e00/0x64919c0f856c1756 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c174f expref: 20 pid: 14416 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545860.271912:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545860.271933:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6de5819a-62ff-4f85-af03-c287b54b27c1+20:3311:x1876474454973568:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545860.271953:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789545860.271968:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789545860.271980:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddeec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6de5819a-62ff-4f85-af03-c287b54b27c1+19:3313:x1876474454973696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789545860.271988:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545860.271992:0:14409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994be4eb6e00/0x64919c0f856c1709 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x64919c0f856c1702 expref: 19 pid: 14417 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545860.272001:0:14409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994be4eb6e00/0x64919c0f856c1709 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x64919c0f856c1702 expref: 19 pid: 14417 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545860.272010:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545860.272036:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddeec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6de5819a-62ff-4f85-af03-c287b54b27c1+19:3313:x1876474454973696:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545860.272042:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789545860.272096:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be3a9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6de5819a-62ff-4f85-af03-c287b54b27c1:3313:1876474454973696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789545860.272120:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be3a9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6de5819a-62ff-4f85-af03-c287b54b27c1:3311:1876474454973568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789545860.272126:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be3a9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6de5819a-62ff-4f85-af03-c287b54b27c1:3311:1876474454973440:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789545860.272495:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789545860.272591:0:16536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc8ba8c00/0x64919c0f856c188a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c1883 expref: 18 pid: 14417 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545860.272604:0:16536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be5193480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16536:1876474454973056:0@lo:104: 00010000:00010000:2.0:1789545860.272615:0:16536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc49d0e00/0x64919c0f856c1756 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c174f expref: 17 pid: 14416 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545860.272631:0:16536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4eddf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16536:1876474454973184:0@lo:104: 00010000:00010000:2.0:1789545860.272642:0:16536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994be4eb6e00/0x64919c0f856c1709 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x64919c0f856c1702 expref: 16 pid: 14417 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545860.272648:0:16536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c1f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16536:1876474454973312:0@lo:104: 00000100:00100000:0.0:1789545860.275919:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545860.275964:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545860.276110:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438203520 00000100:00100000:1.0:1789545860.276121:0:14408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438203520 00010000:00010000:1.0:1789545860.276165:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994bc8ba9200/0x64919c0f856c19b0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5808 expref: 13 pid: 14416 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545860.276194:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438203392 00000100:00100000:1.0:1789545860.276198:0:14408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438203392 00010000:00010000:1.0:1789545860.276210:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994be4eb7a00/0x64919c0f856c19e8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de586a expref: 14 pid: 14417 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545860.276233:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7 00000100:00100000:1.0:1789545860.276242:0:14408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cf44d924-2261-46de-bbbd-7daed3b9d29d+14:2358:x1876474438203520:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789545860.276257:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545860.276277:0:14408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994bc8ba9200/0x64919c0f856c19b0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5808 expref: 14 pid: 14416 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545860.276289:0:14408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994bc8ba9200/0x64919c0f856c19b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5808 expref: 14 pid: 14416 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545860.276321:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789545860.276411:0:14408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cf44d924-2261-46de-bbbd-7daed3b9d29d+14:2358:x1876474438203520:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 169us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545860.276419:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7 00000100:00100000:1.0:1789545860.276435:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8 00000100:00100000:1.0:1789545860.276442:0:14408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cf44d924-2261-46de-bbbd-7daed3b9d29d+13:2358:x1876474438203392:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789545860.276448:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545860.276453:0:14408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994be4eb7a00/0x64919c0f856c19e8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de586a expref: 13 pid: 14417 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545860.276462:0:14408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994be4eb7a00/0x64919c0f856c19e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de586a expref: 13 pid: 14417 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545860.276474:0:14408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff994ac2be8a00/0x64919c0f856c1a12 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545860.276482:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994ac2be8a00/0x64919c0f856c1a12 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545860.276496:0:14408:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994ac2be8a00/0x64919c0f856c1a12 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545860.276504:0:14408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994ac2be8a00/0x64919c0f856c1a12 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545860.276532:0:14408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff994ac2be8a00/0x64919c0f856c1a12 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545860.276540:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff994ac2be8a00/0x64919c0f856c1a12 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545860.276546:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994ac2be8a00 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:1.0:1789545860.276550:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff994ac2be8a00/0x64919c0f856c1a12 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545860.276559:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff994ac2be8a00/0x64919c0f856c1a12 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545860.276568:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff994ac2be8a00/0x64919c0f856c1a12 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545860.276577:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789545860.276594:0:14408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cf44d924-2261-46de-bbbd-7daed3b9d29d+13:2358:x1876474438203392:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 152us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545860.276600:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8 00010000:00010000:3.0:1789545860.277036:0:16536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994be4eb7a00/0x64919c0f856c19e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de586a expref: 12 pid: 14417 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545860.277052:0:16536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be5192680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16536:1876474454972800:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545860.277064:0:16536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994bc8ba9200/0x64919c0f856c19b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5808 expref: 11 pid: 14416 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545860.277071:0:16536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be5192a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16536:1876474454972928:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545860.277102:0:16536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff994ac2be8a00/0x64919c0f856c1a12 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545860.277111:0:16536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff994ac2be8a00/0x64919c0f856c1a12 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545860.277125:0:16536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff994ac2be8a00/0x64919c0f856c1a12 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545860.277131:0:16536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994ac2be8a00/0x64919c0f856c1a12 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545860.669319:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789545861.374116:0:14420:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789545861.374124:0:14420:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994bc2bc3800 from 10 10000000:01000000:1.0:1789545861.374129:0:14420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789545861.374177:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8e00/0x64919c0f856c1a19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545861.374189:0:14420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8e00/0x64919c0f856c1a19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545861.374201:0:14420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8e00/0x64919c0f856c1a19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545861.374240:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f40e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454973824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789545861.374315:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545861.374388:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc9ee1300 going to sleep for 11 seconds 00000100:00100000:0.0:1789545861.374487:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454973824 00000100:00100000:0.0:1789545861.374497:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454973824 00000100:00100000:0.0:1789545861.374560:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789545861.374570:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+16:14420:x1876474454973824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789545861.374583:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545861.374597:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994be4eb6000/0x64919c0f856c1a20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c1a19 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545861.374621:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994be4eb6000/0x64919c0f856c1a20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c1a19 expref: 17 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545861.374632:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994be4eb6000/0x64919c0f856c1a20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c1a19 expref: 17 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545861.374640:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb6000, rc 0) 00000100:00100000:0.0:1789545861.374689:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+17:14420:x1876474454973824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545861.374697:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789545861.375005:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f40e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454973824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789545861.375038:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8e00/0x64919c0f856c1a19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1a20 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545861.375053:0:14420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8e00/0x64919c0f856c1a19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c1a20 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545861.375164:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be3a9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454973952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789545861.375224:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545861.375437:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfae0780 going to sleep for 11 seconds 00000100:00100000:1.0:1789545861.378228:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454973952 00000100:00100000:1.0:1789545861.378322:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454973952 00000100:00100000:1.0:1789545861.379841:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789545861.379861:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+17:14420:x1876474454973952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789545861.383461:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be3a9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454973952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789545861.383531:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454974080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789545861.383584:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545861.383618:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff994be4c27000 going to sleep for 11 seconds 00000100:00100000:0.0:1789545861.383683:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454974080 00000100:00100000:0.0:1789545861.383691:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454974080 00000100:00100000:0.0:1789545861.383754:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789545861.383766:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+18:14420:x1876474454974080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789545861.383845:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+18:14420:x1876474454973952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3395us (8025us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545861.383868:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789545861.384004:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+17:14420:x1876474454974080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 241us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545861.384022:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789545861.384061:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454974080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789545861.395694:0:16576:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789545861.396540:0:14420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789545861.396614:0:14420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789545861.396633:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8e00/0x64919c0f856c1a19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1a20 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545861.396650:0:14420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc8ba8e00/0x64919c0f856c1a19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1a20 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789545861.396665:0:14420:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789545861.396669:0:14420:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994becda0000 from 10 10000000:01000000:3.0:1789545861.396673:0:14420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789545861.396746:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bee11ae00/0x64919c0f856c1a27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545861.396756:0:14420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bee11ae00/0x64919c0f856c1a27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545861.396770:0:14420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bee11ae00/0x64919c0f856c1a27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545861.396807:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be3a9ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454974208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789545861.396898:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545861.396982:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfae0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789545861.397117:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454974208 00000100:00100000:2.0:1789545861.397131:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454974208 00000100:00100000:2.0:1789545861.397199:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789545861.397209:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf541450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+17:14420:x1876474454974208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789545861.397227:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545861.397247:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994ac2be9600/0x64919c0f856c1a2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c1a27 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545861.397275:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994ac2be9600/0x64919c0f856c1a2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c1a27 expref: 18 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545861.397287:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994ac2be9600/0x64919c0f856c1a2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c1a27 expref: 18 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545861.397297:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994ac2be9600, rc 0) 00000100:00100000:2.0:1789545861.397390:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf541450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+18:14420:x1876474454974208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545861.397408:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789545861.397607:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be3a9ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454974208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789545861.397629:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bee11ae00/0x64919c0f856c1a27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1a2e expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545861.397639:0:14420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bee11ae00/0x64919c0f856c1a27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c1a2e expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545861.397711:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be3a9ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454974336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789545861.397744:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545861.397781:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfae0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789545861.398764:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454974336 00000100:00100000:2.0:1789545861.398774:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454974336 00000100:00100000:2.0:1789545861.398897:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789545861.398907:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+18:14420:x1876474454974336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789545861.399316:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+18:14420:x1876474454974336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 410us (1570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545861.399324:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789545861.399394:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be3a9ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454974336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789545861.399446:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454974464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789545861.399486:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545861.399505:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff994be4c27c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789545861.399519:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454974464 00000100:00100000:2.0:1789545861.399523:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454974464 00000100:00100000:2.0:1789545861.399545:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789545861.399551:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf543c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+18:14420:x1876474454974464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789545861.399685:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf543c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+18:14420:x1876474454974464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545861.399692:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789545861.399727:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454974464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789545861.424722:0:16578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789545861.425048:0:14420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789545861.425087:0:14420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789545861.425099:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bee11ae00/0x64919c0f856c1a27 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1a2e expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545861.425112:0:14420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bee11ae00/0x64919c0f856c1a27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1a2e expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789545861.425122:0:14420:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789545861.425125:0:14420:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994bdfb81000 from 10 10000000:01000000:1.0:1789545861.425128:0:14420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789545861.425175:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9200/0x64919c0f856c1a35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545861.425183:0:14420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9200/0x64919c0f856c1a35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545861.425196:0:14420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9200/0x64919c0f856c1a35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545861.425241:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454974592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789545861.425328:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545861.425387:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc9ee1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789545861.425517:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454974592 00000100:00100000:2.0:1789545861.425526:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454974592 00000100:00100000:2.0:1789545861.425585:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789545861.425594:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+18:14420:x1876474454974592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789545861.425617:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545861.425631:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994ac2be9800/0x64919c0f856c1a3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x64919c0f856c1a35 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545861.425655:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994ac2be9800/0x64919c0f856c1a3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x64919c0f856c1a35 expref: 19 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545861.425665:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994ac2be9800/0x64919c0f856c1a3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x64919c0f856c1a35 expref: 19 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545861.425673:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994ac2be9800, rc 0) 00000100:00100000:2.0:1789545861.425713:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+19:14420:x1876474454974592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545861.425721:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789545861.427046:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454974592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789545861.427074:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9200/0x64919c0f856c1a35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1a3c expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545861.427085:0:14420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9200/0x64919c0f856c1a35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x64919c0f856c1a3c expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545861.427160:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454974720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789545861.427211:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545861.427248:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc9ee1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789545861.428281:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454974720 00000100:00100000:2.0:1789545861.428292:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454974720 00000100:00100000:2.0:1789545861.428343:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789545861.428352:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+19:14420:x1876474454974720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789545861.428634:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6de5819a-62ff-4f85-af03-c287b54b27c1+19:14420:x1876474454974720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (1421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545861.428641:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789545861.428991:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454974720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789545861.429039:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454974848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789545861.429087:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545861.429121:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc9ee1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789545861.429408:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454974848 00000100:00100000:2.0:1789545861.429414:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454974848 00000100:00100000:2.0:1789545861.429448:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789545861.429456:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+19:14420:x1876474454974848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789545861.429617:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6de5819a-62ff-4f85-af03-c287b54b27c1+19:14420:x1876474454974848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545861.429633:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789545861.429892:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6de5819a-62ff-4f85-af03-c287b54b27c1:14420:1876474454974848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789545861.431798:0:16581:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789545861.432166:0:14420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789545861.432186:0:14420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789545861.432197:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9200/0x64919c0f856c1a35 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1a3c expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545861.432210:0:14420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.116@tcp lock: ffff994bc8ba9200/0x64919c0f856c1a35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x64919c0f856c1a3c expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545861.698596:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545862.199484:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545862.203888:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438203648 00000100:00100000:2.0:1789545862.203922:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438203648 00000100:00100000:2.0:1789545862.204021:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 115 00000100:00100000:2.0:1789545862.204034:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be41eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf44d924-2261-46de-bbbd-7daed3b9d29d+11:13786:x1876474438203648:12345-192.168.201.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789545862.204056:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545862.204079:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994ac2be9200/0x64919c0f856c1a43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de589b expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545862.204119:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994ac2be9200/0x64919c0f856c1a43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de589b expref: 12 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545862.204133:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994ac2be9200/0x64919c0f856c1a43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de589b expref: 12 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545862.204145:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994ac2be9200, rc 0) 00000100:00100000:2.0:1789545862.204234:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be41eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf44d924-2261-46de-bbbd-7daed3b9d29d+12:13786:x1876474438203648:12345-192.168.201.16@tcp:101:ll_cfg_requeue.0 Request processed in 201us (4768us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545862.204242:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 115 00000100:00100000:1.0:1789545862.214453:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545862.214578:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438203776 00000100:00100000:2.0:1789545862.214595:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438203776 00000100:00100000:2.0:1789545862.214676:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 116 00000100:00100000:2.0:1789545862.214690:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be41ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf44d924-2261-46de-bbbd-7daed3b9d29d+12:13786:x1876474438203776:12345-192.168.201.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789545862.215223:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be41ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf44d924-2261-46de-bbbd-7daed3b9d29d+12:13786:x1876474438203776:12345-192.168.201.16@tcp:501:ll_cfg_requeue.0 Request processed in 532us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545862.215233:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 116 00000100:00100000:0.0:1789545862.223997:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545862.224093:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438203904 00000100:00100000:2.0:1789545862.224108:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438203904 00000100:00100000:2.0:1789545862.224198:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 117 00000100:00100000:2.0:1789545862.224210:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be41ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf44d924-2261-46de-bbbd-7daed3b9d29d+12:13786:x1876474438203904:12345-192.168.201.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789545862.224622:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be41ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf44d924-2261-46de-bbbd-7daed3b9d29d+12:13786:x1876474438203904:12345-192.168.201.16@tcp:503:ll_cfg_requeue.0 Request processed in 412us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545862.224632:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 117 00000100:00100000:2.0:1789545862.232312:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545862.233915:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438204032 00000100:00100000:1.0:1789545862.233940:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438204032 00000100:00100000:1.0:1789545862.234090:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 118 00000100:00100000:1.0:1789545862.234103:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be41ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf44d924-2261-46de-bbbd-7daed3b9d29d+12:13786:x1876474438204032:12345-192.168.201.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789545862.234147:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545862.234176:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994bc8ba8800/0x64919c0f856c1a4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de58a2 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545862.234221:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994bc8ba8800/0x64919c0f856c1a4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58a2 expref: 13 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545862.234235:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994bc8ba8800/0x64919c0f856c1a4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58a2 expref: 13 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545862.234260:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc8ba8800, rc 0) 00000100:00100000:1.0:1789545862.234453:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be41ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf44d924-2261-46de-bbbd-7daed3b9d29d+13:13786:x1876474438204032:12345-192.168.201.16@tcp:101:ll_cfg_requeue.0 Request processed in 351us (2218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545862.234462:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 118 00000100:00100000:0.0:1789545862.240925:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545862.240986:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438204160 00000100:00100000:0.0:1789545862.241000:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438204160 00000100:00100000:0.0:1789545862.241073:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 119 00000100:00100000:0.0:1789545862.241087:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be41ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf44d924-2261-46de-bbbd-7daed3b9d29d+13:13786:x1876474438204160:12345-192.168.201.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789545862.241515:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be41ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf44d924-2261-46de-bbbd-7daed3b9d29d+13:13786:x1876474438204160:12345-192.168.201.16@tcp:501:ll_cfg_requeue.0 Request processed in 428us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545862.241526:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 119 00000100:00100000:2.0:1789545862.246315:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545862.246878:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438204288 00000100:00100000:0.0:1789545862.246895:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438204288 00000100:00100000:0.0:1789545862.247025:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 120 00000100:00100000:0.0:1789545862.247041:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be41efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf44d924-2261-46de-bbbd-7daed3b9d29d+13:13786:x1876474438204288:12345-192.168.201.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789545862.247467:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be41efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf44d924-2261-46de-bbbd-7daed3b9d29d+13:13786:x1876474438204288:12345-192.168.201.16@tcp:503:ll_cfg_requeue.0 Request processed in 428us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545862.247475:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 120 00010000:00010000:3.0:1789545862.750968:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545863.606962:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545863.607007:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545863.607040:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545863.607064:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545863.607083:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545863.607104:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545863.607206:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545863.607236:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438204928 00000100:00100000:2.0:1789545863.607245:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438204928 00000100:00100000:2.0:1789545863.607307:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438204544 00000100:00100000:2.0:1789545863.607311:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438204544 00000100:00100000:2.0:1789545863.607347:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 25 00000100:00100000:2.0:1789545863.607355:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+6:2361:x1876474438204928:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545863.607475:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+6:2361:x1876474438204928:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 120us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545863.607481:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 25 00000100:00100000:2.0:1789545863.607496:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 26 00000100:00100000:2.0:1789545863.607502:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+6:2361:x1876474438204544:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545863.607520:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+6:2361:x1876474438204544:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 18us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545863.607525:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 26 00000100:00100000:2.0:1789545863.607537:0:16051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438204672 00000100:00100000:2.0:1789545863.607540:0:16051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438204672 00000100:00100000:2.0:1789545863.607560:0:16051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438205184 00000100:00100000:2.0:1789545863.607563:0:16051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438205184 00000100:00100000:2.0:1789545863.607574:0:16051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438204800 00000100:00100000:2.0:1789545863.607576:0:16051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438204800 00000100:00100000:2.0:1789545863.607587:0:16051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438205056 00000100:00100000:2.0:1789545863.607589:0:16051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438205056 00000100:00100000:2.0:1789545863.607602:0:16051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 14 00000100:00100000:2.0:1789545863.607608:0:16051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84de17c6-8992-45bc-9c05-8b5bb276e0bb+5:2361:x1876474438204672:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545863.607634:0:16051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84de17c6-8992-45bc-9c05-8b5bb276e0bb+5:2361:x1876474438204672:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 26us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545863.607641:0:16051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 14 00000100:00100000:2.0:1789545863.607652:0:16051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 15 00000100:00100000:2.0:1789545863.607657:0:16051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+5:2361:x1876474438205184:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545863.607681:0:16051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+5:2361:x1876474438205184:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 23us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545863.607694:0:16051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 15 00000100:00100000:1.0:1789545863.607929:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438204416 00000100:00100000:1.0:1789545863.607934:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438204416 00000100:00100000:1.0:1789545863.607982:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 121 00000100:00100000:1.0:1789545863.607991:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be41ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf44d924-2261-46de-bbbd-7daed3b9d29d+13:2361:x1876474438204416:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545863.608021:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be41ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf44d924-2261-46de-bbbd-7daed3b9d29d+13:2361:x1876474438204416:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 32us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545863.608028:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 121 00000100:00100000:1.0:1789545863.608099:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 16 00000100:00100000:1.0:1789545863.608108:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+5:2361:x1876474438204800:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545863.608143:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+5:2361:x1876474438204800:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 36us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545863.608152:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 16 00000100:00100000:1.0:1789545863.608181:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 17 00000100:00100000:1.0:1789545863.608191:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+5:2361:x1876474438205056:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1789545863.608231:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+5:2361:x1876474438205056:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 42us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545863.608236:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 17 00000100:00080000:1.0:1789545863.608279:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789545863.608284:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789545863.608287:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789545863.804776:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545864.077325:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545864.079443:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438205312 00000100:00100000:2.0:1789545864.079462:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438205312 00000100:00100000:2.0:1789545864.079550:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 15 00000100:00100000:2.0:1789545864.079561:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+6:14439:x1876474438205312:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789545864.079586:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545864.079645:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8800/0x64919c0f856c1a51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de58a9 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.079721:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8e00/0x64919c0f856c1a58 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.079735:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8e00/0x64919c0f856c1a58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.079748:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8e00/0x64919c0f856c1a58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.079763:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1a5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.079770:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1a5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.079777:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1a5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.080425:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8600/0x64919c0f856c1a66 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.080448:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8600/0x64919c0f856c1a66 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.080457:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8600/0x64919c0f856c1a66 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545864.080489:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789545864.080493:0:14423:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789545864.080530:0:14423:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8600/0x64919c0f856c1a66 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.080541:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8e00/0x64919c0f856c1a58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.080547:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8e00/0x64919c0f856c1a58 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.080554:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8e00/0x64919c0f856c1a58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.080560:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994ac2be8e00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545864.080564:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8e00/0x64919c0f856c1a58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.080572:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8e00/0x64919c0f856c1a58 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.080585:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:2.0:1789545864.080587:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545864.080592:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8e00/0x64919c0f856c1a58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.080609:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8e00/0x64919c0f856c1a58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.080626:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1a5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.080633:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1a5f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.080638:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1a5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.080643:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994ac2be8c00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545864.080646:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1a5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.080651:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1a5f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.080659:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff994bc53dc000) 00010000:00010000:2.0:1789545864.080662:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545864.080665:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1a5f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.080670:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1a5f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.080709:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8800/0x64919c0f856c1a51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58a9 expref: 8 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.080736:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8600/0x64919c0f856c1a66 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58a9 expref: 7 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.080744:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff994bc53dc900) 00010000:00010000:2.0:1789545864.080747:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789545864.080749:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994ac2be8600, rc 0) 00000100:00100000:2.0:1789545864.080841:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+7:14439:x1876474438205312:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 1280us (3528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545864.080850:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 15 00000100:00100000:0.0:1789545864.087228:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545864.087407:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438205568 00000100:00100000:1.0:1789545864.087421:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438205568 00000100:00100000:1.0:1789545864.087764:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 16 00000100:00100000:1.0:1789545864.087778:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+7:14439:x1876474438205568:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789545864.087810:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545864.087838:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9a00/0x64919c0f856c1a6d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de58b0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.087946:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1a74 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.087964:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1a74 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.087979:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1a74 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.094932:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8c00/0x64919c0f856c1a7b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.094975:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8c00/0x64919c0f856c1a7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.094990:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8c00/0x64919c0f856c1a7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.095440:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0e00/0x64919c0f856c1a82 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.095453:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0e00/0x64919c0f856c1a82 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.095461:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0e00/0x64919c0f856c1a82 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789545864.095474:0:14424:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789545864.095704:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1a74 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.095713:0:14424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1a74 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.095720:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1a74 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.095726:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba8200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545864.095731:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1a74 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.095740:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1a74 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.095764:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff994bc53dc900) 00010000:00010000:1.0:1789545864.095767:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545864.095773:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1a74 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.095780:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8200/0x64919c0f856c1a74 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.095793:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8c00/0x64919c0f856c1a7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.095800:0:14424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8c00/0x64919c0f856c1a7b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.095807:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8c00/0x64919c0f856c1a7b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.095813:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc8ba8c00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545864.095816:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8c00/0x64919c0f856c1a7b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.095821:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8c00/0x64919c0f856c1a7b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.095828:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff994bc4ffe000) 00010000:00010000:1.0:1789545864.095831:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545864.095833:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8c00/0x64919c0f856c1a7b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.095840:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba8c00/0x64919c0f856c1a7b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.105009:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc8ba9a00/0x64919c0f856c1a6d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58b0 expref: 10 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.105038:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0e00/0x64919c0f856c1a82 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58b0 expref: 9 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.105047:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff994bc4ffee00) 00010000:00010000:1.0:1789545864.105050:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545864.105053:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0e00, rc 0) 00000100:00100000:1.0:1789545864.105142:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+9:14439:x1876474438205568:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 17366us (17936us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789545864.105153:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 16 00000100:00100000:3.0:1789545864.120568:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545864.123525:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438205696 00000100:00100000:2.0:1789545864.123545:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438205696 00000100:00100000:2.0:1789545864.123843:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 17 00000100:00100000:2.0:1789545864.123856:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+9:14439:x1876474438205696:12345-192.168.201.16@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789545864.124178:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+9:14439:x1876474438205696:12345-192.168.201.16@tcp:59:lhsmtool_posix.0 Request processed in 323us (4053us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545864.124187:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 17 00000100:00100000:0.0:1789545864.155546:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545864.155730:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438205824 00000100:00100000:2.0:1789545864.155814:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438205824 00000100:00100000:2.0:1789545864.155900:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 18 00000100:00100000:2.0:1789545864.155912:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+9:14445:x1876474438205824:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:2.0:1789545864.155939:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545864.155964:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8800/0x64919c0f856c1a90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de58b7 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.156117:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1a97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.156152:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1a97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.156166:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1a97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.156185:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8e00/0x64919c0f856c1a9e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.156192:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8e00/0x64919c0f856c1a9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.156199:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8e00/0x64919c0f856c1a9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.157226:0:14425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1a97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.157243:0:14425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1a97 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.157580:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1a97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.157588:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994ac2be8c00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545864.157593:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1a97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.157602:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1a97 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.157621:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:2.0:1789545864.157640:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545864.157647:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1a97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.157654:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1a97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.157675:0:14425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8e00/0x64919c0f856c1a9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.158716:0:14425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8e00/0x64919c0f856c1a9e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.158727:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8e00/0x64919c0f856c1a9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.158734:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994ac2be8e00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545864.158738:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8e00/0x64919c0f856c1a9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.159071:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8e00/0x64919c0f856c1a9e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.159090:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff994bc53dc000) 00010000:00010000:2.0:1789545864.159094:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545864.159099:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8e00/0x64919c0f856c1a9e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.159106:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8e00/0x64919c0f856c1a9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.159188:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8800/0x64919c0f856c1a90 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58b7 expref: 10 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.159222:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:2.0:1789545864.159225:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545864.159230:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8800/0x64919c0f856c1a90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58b7 expref: 10 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.159242:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994ac2be8800, rc 0) 00000100:00100000:2.0:1789545864.159340:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+9:14445:x1876474438205824:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 3429us (3808us total) trans 0 rc 301/301 00000100:00100000:2.0:1789545864.159352:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 18 00000100:00100000:1.0:1789545864.166108:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545864.168616:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438205952 00000100:00100000:3.0:1789545864.168635:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438205952 00000100:00100000:3.0:1789545864.168711:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 0 00000100:00100000:3.0:1789545864.168723:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+9:14445:x1876474438205952:12345-192.168.201.16@tcp:700:lfs.0 00000100:00100000:3.0:1789545864.168859:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+9:14445:x1876474438205952:12345-192.168.201.16@tcp:700:lfs.0 Request processed in 139us (2767us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545864.168866:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 0 00000100:00100000:0.0:1789545864.171106:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545864.171228:0:15758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438206208 00000100:00100000:1.0:1789545864.171253:0:15758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438206208 00000100:00100000:1.0:1789545864.171326:0:15758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 19 00000100:00100000:1.0:1789545864.171337:0:15758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84de17c6-8992-45bc-9c05-8b5bb276e0bb+9:14445:x1876474438206208:12345-192.168.201.16@tcp:36:lfs.0 00010000:00010000:1.0:1789545864.171463:0:15758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545864.173106:0:15758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c19d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5832 expref: 9 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.173144:0:15758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:1.0:1789545864.173151:0:15758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789545864.173530:0:15758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1aa5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.173561:0:15758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1a0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5894 expref: 5 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.173570:0:15758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1aa5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.173614:0:15758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1a0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5894 expref: 5 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.173634:0:15758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1a0b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5894 expref: 5 pid: 14425 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545864.173653:0:15758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f42a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15758:1876474454974976:192.168.201.16@tcp:104: 00000100:00100000:1.0:1789545864.175686:0:15758:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc9ee1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789545864.192350:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545864.192892:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438206336 00000100:00100000:2.0:1789545864.192906:0:14408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438206336 00010000:00010000:2.0:1789545864.192964:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1a0b lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5894 expref: 6 pid: 14425 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545864.193020:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9 00000100:00100000:2.0:1789545864.193032:0:14408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+6:2359:x1876474438206336:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789545864.193052:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545864.193061:0:14408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1a0b lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5894 expref: 6 pid: 14425 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.193076:0:14408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1a0b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5894 expref: 6 pid: 14425 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.193105:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:2.0:1789545864.193111:0:14408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1aa5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.193132:0:14408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1aa5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.193142:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1aa5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.193168:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789545864.193243:0:14408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+6:2359:x1876474438206336:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 212us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545864.193251:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9 00010000:00010000:1.0:1789545864.197053:0:15758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1a0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5894 expref: 5 pid: 14425 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545864.197092:0:15758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f42a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15758:1876474454974976:192.168.201.16@tcp:104: 00010000:00010000:1.0:1789545864.197127:0:15758:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1aa5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.197141:0:15758:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1aa5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.197148:0:15758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1aa5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.197188:0:15758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1aac lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.197226:0:15758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1aac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.197239:0:15758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1aac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789545864.202289:0:15758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789545864.202316:0:15758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1aa5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.202328:0:15758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1aa5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.202337:0:15758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1aa5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.202345:0:15758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1e00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545864.202350:0:15758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1aa5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.202384:0:15758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1aa5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.202407:0:15758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4f11400) 00010000:00010000:1.0:1789545864.202410:0:15758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545864.202417:0:15758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1aa5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.202424:0:15758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1aa5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789545864.203680:0:15758:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e0ca7cf9 reply state 00000000c24a58b1 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1aac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545864.203700:0:15758:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789545864.204176:0:15758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84de17c6-8992-45bc-9c05-8b5bb276e0bb+10:14445:x1876474438206208:12345-192.168.201.16@tcp:36:lfs.0 Request processed in 32832us (33077us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789545864.204188:0:15758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 19 00010000:00010000:1.0:1789545864.210725:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1aac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.210756:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1aac lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.210765:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1aac lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.210772:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545864.210778:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1aac lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.210787:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1aac lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.210807:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff994bc4ffe000) 00010000:00010000:1.0:1789545864.210811:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545864.210817:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1aac lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.210823:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1aac lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545864.253914:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454975104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789545864.254015:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545864.255050:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454975104 00000100:00100000:3.0:1789545864.255065:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454975104 00000100:00100000:3.0:1789545864.255161:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789545864.255174:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454975104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789545864.255225:0:15112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789545864.255335:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789545864.256993:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454975104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1811us (2968us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545864.257010:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789545864.263382:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454975104:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1789545864.317294:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789545864.323969:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545864.325321:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438206464 00000100:00100000:1.0:1789545864.325342:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438206464 00000100:00100000:1.0:1789545864.326035:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 20 00000100:00100000:1.0:1789545864.326053:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+9:14453:x1876474438206464:12345-192.168.201.16@tcp:101:lctl.0 00010000:00010000:1.0:1789545864.326089:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545864.326121:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1ab3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de58be expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.326213:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c1aba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.326232:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c1aba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.326247:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c1aba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789545864.326294:0:14424:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789545864.326298:0:14424:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789545864.326346:0:14424:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c1aba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.326416:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1ab3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58be expref: 11 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.326476:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0200/0x64919c0f856c1aba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58be expref: 10 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.326495:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4ffe000) 00010000:00010000:1.0:1789545864.326499:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789545864.326503:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0200, rc 0) 00000100:00100000:1.0:1789545864.326581:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+10:14453:x1876474438206464:12345-192.168.201.16@tcp:101:lctl.0 Request processed in 533us (2626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545864.326589:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 20 00000100:00100000:0.0:1789545864.354083:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545864.354196:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438206592 00000100:00100000:2.0:1789545864.354210:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438206592 00000100:00100000:2.0:1789545864.354286:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 21 00000100:00100000:2.0:1789545864.354299:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+5:14454:x1876474438206592:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:2.0:1789545864.354328:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545864.354353:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8800/0x64919c0f856c1ac1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de58c5 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.354613:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8e00/0x64919c0f856c1ac8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.354632:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8e00/0x64919c0f856c1ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.354645:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8e00/0x64919c0f856c1ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545864.354759:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789545864.354764:0:14423:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789545864.354790:0:14423:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8e00/0x64919c0f856c1ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.354818:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8800/0x64919c0f856c1ac1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58c5 expref: 7 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.354842:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8e00/0x64919c0f856c1ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58c5 expref: 6 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.354852:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4ffe000) 00010000:00010000:2.0:1789545864.354855:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789545864.354860:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994ac2be8e00, rc 0) 00000100:00100000:2.0:1789545864.355039:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+6:14454:x1876474438206592:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 741us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545864.355048:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 21 00000100:00100000:0.0:1789545864.358768:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545864.358846:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438206720 00000100:00100000:2.0:1789545864.358861:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438206720 00000100:00100000:2.0:1789545864.358949:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 22 00000100:00100000:2.0:1789545864.358962:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+6:14454:x1876474438206720:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:2.0:1789545864.358990:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545864.359018:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1acf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de58cc expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.359106:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9c00/0x64919c0f856c1ad6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.359146:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9c00/0x64919c0f856c1ad6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.359159:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9c00/0x64919c0f856c1ad6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.359177:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8400/0x64919c0f856c1add lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.359185:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8400/0x64919c0f856c1add lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.359191:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8400/0x64919c0f856c1add lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.366438:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8800/0x64919c0f856c1ae4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.366463:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8800/0x64919c0f856c1ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.366476:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8800/0x64919c0f856c1ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545864.366538:0:14425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789545864.366543:0:14425:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789545864.366566:0:14425:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8800/0x64919c0f856c1ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.366582:0:14425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9c00/0x64919c0f856c1ad6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.366607:0:14425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9c00/0x64919c0f856c1ad6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.366615:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9c00/0x64919c0f856c1ad6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.366621:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994ac2be9c00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545864.366625:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9c00/0x64919c0f856c1ad6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.366633:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9c00/0x64919c0f856c1ad6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.366649:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4ffe000) 00010000:00010000:2.0:1789545864.366652:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545864.366658:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9c00/0x64919c0f856c1ad6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.366664:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9c00/0x64919c0f856c1ad6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.366681:0:14425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8400/0x64919c0f856c1add lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.366686:0:14425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8400/0x64919c0f856c1add lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.366692:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8400/0x64919c0f856c1add lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.366698:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994ac2be8400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545864.366707:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8400/0x64919c0f856c1add lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.366713:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8400/0x64919c0f856c1add lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.366720:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff994bc53dc000) 00010000:00010000:2.0:1789545864.366723:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545864.366726:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8400/0x64919c0f856c1add lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.366732:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8400/0x64919c0f856c1add lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.366782:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1acf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58cc expref: 8 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.366799:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8800/0x64919c0f856c1ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58cc expref: 7 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.366806:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff994bc53dc700) 00010000:00010000:2.0:1789545864.366808:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789545864.366811:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994ac2be8800, rc 0) 00000100:00100000:2.0:1789545864.366910:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+7:14454:x1876474438206720:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 7949us (8151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545864.366920:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 22 00000100:00100000:3.0:1789545864.370554:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545864.371829:0:15758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438206976 00000100:00100000:1.0:1789545864.371848:0:15758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438206976 00000100:00100000:1.0:1789545864.371955:0:15758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 23 00000100:00100000:1.0:1789545864.371968:0:15758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+7:14454:x1876474438206976:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:1.0:1789545864.371998:0:15758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545864.372028:0:15758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1aeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de58d3 expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789545864.372164:0:15758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789545864.372338:0:15758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1aeb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58d3 expref: 9 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.372355:0:15758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4ffe000) 00010000:00010000:1.0:1789545864.372489:0:15758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789545864.372495:0:15758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1aeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58d3 expref: 9 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.372532:0:15758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1e00, rc 0) 00000100:00100000:1.0:1789545864.372663:0:15758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+8:14454:x1876474438206976:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 697us (2121us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1789545864.373290:0:15758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 23 00000100:00100000:0.0:1789545864.385196:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545864.385286:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438207232 00000100:00100000:1.0:1789545864.385316:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438207232 00000100:00100000:1.0:1789545864.385427:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 24 00000100:00100000:1.0:1789545864.385441:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+8:14454:x1876474438207232:12345-192.168.201.16@tcp:36:lfs.0 00010000:00010000:1.0:1789545864.385524:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545864.385560:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8800/0x64919c0f856c1ae4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58cc expref: 8 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.385586:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff994bc53dc700) 00010000:00010000:1.0:1789545864.385602:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789545864.386014:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1af9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.386032:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1af9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.386044:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1af9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789545864.386330:0:14424:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e1bc26d reply state 00000000090914cc transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1af9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545864.386341:0:14424:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789545864.386507:0:14424:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789545864.386639:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+9:14454:x1876474438207232:12345-192.168.201.16@tcp:36:lfs.0 Request processed in 1199us (1453us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789545864.386649:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 24 00000100:00100000:3.0:1789545864.391009:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:2.0:1789545864.391039:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1af9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.391059:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1af9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.391083:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1af9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.391090:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1e00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545864.391095:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1af9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.391105:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1af9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.391126:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff994bc4ffe400) 00010000:00010000:2.0:1789545864.391129:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789545864.391135:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1af9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.391141:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1e00/0x64919c0f856c1af9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545864.397942:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438207488 00000100:00100000:2.0:1789545864.397959:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438207488 00000100:00100000:2.0:1789545864.398048:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2 00000100:00100000:2.0:1789545864.398060:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+8:14454:x1876474438207488:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:2.0:1789545864.398340:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+9:14454:x1876474438207488:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 282us (7349us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789545864.398348:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2 00000100:00100000:3.0:1789545864.413091:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545864.413982:0:15758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438207744 00000100:00100000:1.0:1789545864.414003:0:15758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438207744 00000100:00100000:1.0:1789545864.416268:0:15758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 25 00000100:00100000:1.0:1789545864.416284:0:15758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+9:14454:x1876474438207744:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:1.0:1789545864.416311:0:15758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545864.416334:0:15758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1b00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de58da expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.416693:0:15758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c1b07 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.416707:0:15758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c1b07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.416717:0:15758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c1b07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.416749:0:15758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1b0e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.416756:0:15758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1b0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.416761:0:15758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1b0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789545864.417071:0:15758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789545864.417203:0:15758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c1b07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.417211:0:15758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c1b07 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.417218:0:15758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c1b07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.417224:0:15758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1600 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545864.417229:0:15758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c1b07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.417236:0:15758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c1b07 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.417250:0:15758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4ffe000) 00010000:00010000:1.0:1789545864.417253:0:15758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545864.417258:0:15758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c1b07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.417264:0:15758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c1b07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.417278:0:15758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1b0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.417284:0:15758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1b0e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.417291:0:15758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1b0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.417308:0:15758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d0000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545864.417311:0:15758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1b0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.417316:0:15758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1b0e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.417323:0:15758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff994bc4ffe100) 00010000:00010000:1.0:1789545864.417326:0:15758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545864.417328:0:15758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1b0e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.417334:0:15758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1b0e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.417461:0:15758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1b00 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58da expref: 11 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.417472:0:15758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4ffe000) 00010000:00010000:1.0:1789545864.417474:0:15758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789545864.417478:0:15758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1b00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58da expref: 11 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.417489:0:15758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1c00, rc 0) 00000100:00100000:1.0:1789545864.417626:0:15758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+10:14454:x1876474438207744:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 1344us (4553us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1789545864.417635:0:15758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 25 00000100:00100000:1.0:1789545864.430651:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545864.430782:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438207872 00000100:00100000:2.0:1789545864.430793:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438207872 00000100:00100000:2.0:1789545864.430858:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 26 00000100:00100000:2.0:1789545864.430876:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+10:14454:x1876474438207872:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:2.0:1789545864.430918:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545864.430943:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1b1c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de58e1 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.431046:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8400/0x64919c0f856c1b23 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.431059:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8400/0x64919c0f856c1b23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.431070:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8400/0x64919c0f856c1b23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545864.431101:0:14425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789545864.431105:0:14425:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789545864.431124:0:14425:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8400/0x64919c0f856c1b23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.431158:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1b1c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58e1 expref: 12 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.431187:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8400/0x64919c0f856c1b23 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58e1 expref: 11 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.431195:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff994bc53dc000) 00010000:00010000:2.0:1789545864.431197:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789545864.431200:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994ac2be8400, rc 0) 00000100:00100000:2.0:1789545864.431274:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+11:14454:x1876474438207872:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 407us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545864.431290:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 26 00000100:00100000:3.0:1789545864.456208:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545864.456333:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438208000 00000100:00100000:2.0:1789545864.456350:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438208000 00000100:00100000:2.0:1789545864.456480:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3 00000100:00100000:2.0:1789545864.456493:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+11:14454:x1876474438208000:12345-192.168.201.16@tcp:37:lfs.0 00000100:00100000:0.0:1789545864.460412:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+11:14454:x1876474438208000:12345-192.168.201.16@tcp:37:lfs.0 Request processed in 3864us (4162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545864.460428:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3 00000100:00100000:1.0:1789545864.468285:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545864.468411:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438208256 00000100:00100000:3.0:1789545864.468423:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438208256 00000100:00100000:3.0:1789545864.468477:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 4 00000100:00100000:3.0:1789545864.468488:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bee0e9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+11:14454:x1876474438208256:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:3.0:1789545864.470066:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bee0e9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+12:14454:x1876474438208256:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 1570us (1781us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789545864.470079:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 4 00000100:00100000:3.0:1789545864.547519:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545864.547649:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438208384 00000100:00100000:2.0:1789545864.547665:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438208384 00000100:00100000:2.0:1789545864.547749:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 27 00000100:00100000:2.0:1789545864.547760:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+10:14460:x1876474438208384:12345-192.168.201.16@tcp:101:bash.0 00010000:00010000:2.0:1789545864.547781:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545864.547802:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1b2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de58e8 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.547880:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9c00/0x64919c0f856c1b31 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.547894:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9c00/0x64919c0f856c1b31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.547905:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9c00/0x64919c0f856c1b31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.547921:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1b38 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.547928:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1b38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.547934:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1b38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.548055:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9400/0x64919c0f856c1b3f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.548065:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9400/0x64919c0f856c1b3f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.548072:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9400/0x64919c0f856c1b3f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545864.548104:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789545864.548109:0:14423:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789545864.548153:0:14423:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9400/0x64919c0f856c1b3f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.548168:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9c00/0x64919c0f856c1b31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.548175:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9c00/0x64919c0f856c1b31 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.548182:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9c00/0x64919c0f856c1b31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.548189:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994ac2be9c00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545864.548193:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9c00/0x64919c0f856c1b31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.548202:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9c00/0x64919c0f856c1b31 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.548215:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4ffe000) 00010000:00010000:2.0:1789545864.548223:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545864.548229:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9c00/0x64919c0f856c1b31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.548235:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9c00/0x64919c0f856c1b31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.548251:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1b38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.548257:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1b38 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.548263:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1b38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.548290:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994ac2be8200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545864.548294:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1b38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.548300:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1b38 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.548308:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff994bc53dc400) 00010000:00010000:2.0:1789545864.548310:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545864.548313:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1b38 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.548318:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1b38 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.548356:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1b2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58e8 expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.548441:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9400/0x64919c0f856c1b3f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58e8 expref: 11 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.548450:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff994bc53dc000) 00010000:00010000:2.0:1789545864.548453:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789545864.548456:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994ac2be9400, rc 0) 00000100:00100000:2.0:1789545864.548540:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+11:14460:x1876474438208384:12345-192.168.201.16@tcp:101:bash.0 Request processed in 781us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545864.548549:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 27 00000100:00100000:2.0:1789545864.553322:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545864.553430:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438208640 00000100:00100000:1.0:1789545864.553449:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438208640 00000100:00100000:1.0:1789545864.553536:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 28 00000100:00100000:1.0:1789545864.553547:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+11:14460:x1876474438208640:12345-192.168.201.16@tcp:101:bash.0 00010000:00010000:1.0:1789545864.553585:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545864.553606:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c1b46 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de58ef expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.553733:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c1b4d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.553750:0:14425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8400/0x64919c0f856c1b23 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58e1 expref: 11 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.553764:0:14425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c1b4d lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.553801:0:14425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8400/0x64919c0f856c1b23 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58e1 expref: 11 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.553814:0:14425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8400/0x64919c0f856c1b23 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58e1 expref: 11 pid: 14425 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545864.553826:0:14425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4f41c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14425:1876474454975232:192.168.201.16@tcp:104: 00000100:00100000:1.0:1789545864.553944:0:14425:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc9ee1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789545864.561225:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545864.561820:0:14425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4f41c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14425:1876474454975232:192.168.201.16@tcp:104: 00010000:00010000:2.0:1789545864.561861:0:14425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c1b4d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545864.562012:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438208768 00000100:00100000:3.0:1789545864.562023:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438208768 00010000:00010000:3.0:1789545864.562092:0:14409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8400/0x64919c0f856c1b23 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58e1 expref: 12 pid: 14425 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545864.562140:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10 00000100:00100000:3.0:1789545864.562152:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+12:2360:x1876474438208768:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789545864.562170:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545864.562179:0:14409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8400/0x64919c0f856c1b23 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58e1 expref: 12 pid: 14425 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545864.562193:0:14409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8400/0x64919c0f856c1b23 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58e1 expref: 12 pid: 14425 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545864.562223:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8400/0x64919c0f856c1b23 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58e1 expref: 12 pid: 14425 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545864.562247:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff994bc53dc000) 00010000:00010000:3.0:1789545864.562252:0:14409:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c1b4d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545864.562263:0:14409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c1b4d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545864.562273:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c1b4d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545864.562795:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545864.562882:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+11:2360:x1876474438208768:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 729us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545864.562892:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10 00010000:00010000:2.0:1789545864.566231:0:14425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c1b4d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.566257:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c1b4d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.566315:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1b54 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.566332:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1b54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.566345:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1b54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.575672:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1b5b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.575693:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1b5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.575706:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1b5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545864.575719:0:14425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789545864.575750:0:14425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c1b4d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.575757:0:14425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c1b4d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.575764:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c1b4d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.575769:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545864.575774:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c1b4d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.575780:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c1b4d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.575792:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff994bc53dc000) 00010000:00010000:2.0:1789545864.575795:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545864.575799:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c1b4d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.575819:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1200/0x64919c0f856c1b4d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789545864.575833:0:14425:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000260556e6 reply state 000000001dc8d87e transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1b54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545864.575841:0:14425:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789545864.575893:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c1b46 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58ef expref: 14 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.575908:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1b5b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58ef expref: 13 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.575915:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994bc53dc500) 00010000:00010000:2.0:1789545864.575917:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789545864.575920:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994ac2be8200, rc 0) 00000100:00100000:2.0:1789545864.576029:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+14:14460:x1876474438208640:12345-192.168.201.16@tcp:101:bash.0 Request processed in 22483us (22736us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789545864.576039:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 28 00010000:00010000:2.0:1789545864.586458:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1b54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.586479:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1b54 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.586489:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1b54 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.586495:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994ac2be8c00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545864.586519:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1b54 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.586528:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1b54 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.586547:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff994bc53dc400) 00010000:00010000:2.0:1789545864.586551:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789545864.586556:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1b54 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.586563:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1b54 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545864.595284:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545864.595410:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438208896 00000100:00100000:0.0:1789545864.595431:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438208896 00000100:00100000:0.0:1789545864.595530:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 29 00000100:00100000:0.0:1789545864.595543:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+13:14460:x1876474438208896:12345-192.168.201.16@tcp:101:bash.0 00010000:00010000:0.0:1789545864.595574:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545864.595648:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6e00/0x64919c0f856c1b69 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de58f6 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545864.595724:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6a00/0x64919c0f856c1b70 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545864.595741:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6a00/0x64919c0f856c1b70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545864.595754:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6a00/0x64919c0f856c1b70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789545864.595802:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789545864.595806:0:14423:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789545864.595830:0:14423:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6a00/0x64919c0f856c1b70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545864.595851:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6a00/0x64919c0f856c1b70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545864.595909:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6e00/0x64919c0f856c1b69 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58f6 expref: 15 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545864.595931:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6a00/0x64919c0f856c1b70 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58f6 expref: 14 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545864.595941:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994bc53dc500) 00010000:00010000:0.0:1789545864.595944:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789545864.595957:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb6a00, rc 0) 00000100:00100000:0.0:1789545864.596046:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+14:14460:x1876474438208896:12345-192.168.201.16@tcp:101:bash.0 Request processed in 506us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545864.596053:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 29 00000100:00100000:0.0:1789545864.600902:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545864.601353:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438209152 00000100:00100000:3.0:1789545864.601524:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438209152 00000100:00100000:2.0:1789545864.602594:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 5 00000100:00100000:2.0:1789545864.602613:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+14:14460:x1876474438209152:12345-192.168.201.16@tcp:35:bash.0 00000001:00080000:2.0:1789545864.603154:0:14427:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934601 00000100:00100000:2.0:1789545864.603342:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+16:14460:x1876474438209152:12345-192.168.201.16@tcp:35:bash.0 Request processed in 732us (2455us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1789545864.603351:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 5 00000020:00080000:2.0:1789545864.603385:0:14427:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789545864.714892:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545864.715074:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438209408 00000100:00100000:1.0:1789545864.715088:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438209408 00000100:00100000:1.0:1789545864.715243:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 30 00000100:00100000:1.0:1789545864.715275:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+16:14470:x1876474438209408:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:1.0:1789545864.715312:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545864.715340:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c1b77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de58fd expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789545864.715527:0:14424:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789545864.715694:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c1b77 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58fd expref: 18 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.715712:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994bc4ffe000) 00010000:00010000:1.0:1789545864.715715:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789545864.715721:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c1b77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58fd expref: 18 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.715739:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d1600, rc 0) 00000100:00100000:1.0:1789545864.715808:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+17:14470:x1876474438209408:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 538us (933us total) trans 8589934603 rc 301/301 00000100:00100000:1.0:1789545864.715817:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 30 00000100:00100000:3.0:1789545864.723389:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545864.723828:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438209664 00000100:00100000:0.0:1789545864.723842:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438209664 00000100:00100000:0.0:1789545864.723995:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 6 00000100:00100000:0.0:1789545864.724009:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+17:14470:x1876474438209664:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:0.0:1789545864.724439:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+18:14470:x1876474438209664:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 428us (1141us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1789545864.724881:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 6 00000100:00100000:0.0:1789545864.783073:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545864.787699:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438209920 00000100:00100000:2.0:1789545864.787725:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438209920 00000100:00100000:2.0:1789545864.787830:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 31 00000100:00100000:2.0:1789545864.787843:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+18:14473:x1876474438209920:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:2.0:1789545864.787889:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545864.787917:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9c00/0x64919c0f856c1b85 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5904 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.788069:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9a00/0x64919c0f856c1b8c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.788087:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9a00/0x64919c0f856c1b8c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.788102:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9a00/0x64919c0f856c1b8c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545864.788116:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789545864.788278:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9c00/0x64919c0f856c1b85 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5904 expref: 21 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.788317:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9a00/0x64919c0f856c1b8c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5904 expref: 20 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545864.788327:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994bc53dc500) 00010000:00010000:2.0:1789545864.788330:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789545864.788335:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994ac2be9a00, rc 0) 00000100:00100000:2.0:1789545864.788492:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+20:14473:x1876474438209920:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 651us (5434us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789545864.788502:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 31 00000100:00100000:2.0:1789545864.792712:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545864.793748:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438210048 00000100:00100000:1.0:1789545864.793766:0:14408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438210048 00000100:00100000:1.0:1789545864.793880:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 0 00000100:00100000:1.0:1789545864.793893:0:14408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+20:2360:x1876474438210048:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789545864.793914:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545864.793946:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9a00/0x64919c0f856c1b8c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5904 expref: 20 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.793974:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994bc53dc500) 00010000:00010000:1.0:1789545864.793999:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789545864.794297:0:14408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+19:2360:x1876474438210048:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 404us (1595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545864.794675:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 0 00000100:00100000:2.0:1789545864.800555:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545864.800792:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438210176 00000100:00100000:1.0:1789545864.800806:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438210176 00000100:00100000:1.0:1789545864.800903:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 32 00000100:00100000:1.0:1789545864.800915:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+19:14473:x1876474438210176:12345-192.168.201.16@tcp:54:lfs.0 00010000:00010000:1.0:1789545864.801002:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c1b9a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.801023:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c1b9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.801037:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c1b9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.801069:0:14425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c1b9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.801079:0:14425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c1b9a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.801086:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c1b9a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.801091:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1600 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545864.801097:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c1b9a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.801106:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c1b9a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.801141:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994bc53dc500) 00010000:00010000:1.0:1789545864.801144:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789545864.801150:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c1b9a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545864.801157:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1600/0x64919c0f856c1b9a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545864.801240:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+19:14473:x1876474438210176:12345-192.168.201.16@tcp:54:lfs.0 Request processed in 327us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545864.801249:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 32 00000100:00100000:3.0:1789545864.809835:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545864.809973:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438210432 00000100:00100000:2.0:1789545864.809987:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438210432 00000100:00100000:2.0:1789545864.810060:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7 00000100:00100000:2.0:1789545864.810072:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+19:14473:x1876474438210432:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:2.0:1789545864.811706:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+20:14473:x1876474438210432:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 1619us (1871us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789545864.811724:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7 00010000:00010000:3.0:1789545864.829397:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545865.228492:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545865.228612:0:15758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438210688 00000100:00100000:0.0:1789545865.228626:0:15758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438210688 00000100:00100000:0.0:1789545865.228793:0:15758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 33 00000100:00100000:0.0:1789545865.228810:0:15758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84de17c6-8992-45bc-9c05-8b5bb276e0bb+20:14504:x1876474438210688:12345-192.168.201.16@tcp:101:cat.0 00010000:00010000:0.0:1789545865.228873:0:15758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545865.228901:0:15758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c1ba1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de590b expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545865.229030:0:15758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1ba8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545865.229048:0:15758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545865.229064:0:15758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789545865.229077:0:15758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789545865.229264:0:15758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c1ba1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de590b expref: 23 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545865.229289:0:15758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de590b expref: 22 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545865.229299:0:15758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994bc53dc500) 00010000:00010000:0.0:1789545865.229302:0:15758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789545865.229307:0:15758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb7200, rc 0) 00000100:00100000:0.0:1789545865.229439:0:15758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84de17c6-8992-45bc-9c05-8b5bb276e0bb+22:14504:x1876474438210688:12345-192.168.201.16@tcp:101:cat.0 Request processed in 634us (961us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1789545865.229448:0:15758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 33 00000100:00080000:2.0:1789545865.230076:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789545865.234323:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545865.234696:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438210944 00000100:00100000:3.0:1789545865.234709:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438210944 00000100:00100000:3.0:1789545865.234787:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8 00000100:00100000:3.0:1789545865.234800:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+22:14504:x1876474438210944:12345-192.168.201.16@tcp:35:cat.0 00000100:00100000:3.0:1789545865.237116:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+23:14504:x1876474438210944:12345-192.168.201.16@tcp:35:cat.0 Request processed in 2305us (2802us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1789545865.237132:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8 00000100:00100000:3.0:1789545865.243502:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545865.243618:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438211072 00000100:00100000:1.0:1789545865.243636:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438211072 00000100:00100000:1.0:1789545865.243746:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1 00000100:00100000:1.0:1789545865.243760:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+23:2361:x1876474438211072:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789545865.243780:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545865.243814:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1ba8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de590b expref: 23 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545865.243845:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994bc53dc500) 00010000:00010000:1.0:1789545865.243862:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789545865.245317:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+22:2361:x1876474438211072:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1546us (1813us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545865.245339:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1 00000100:00100000:1.0:1789545865.277119:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789545865.277188:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be3a9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454975360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789545865.277318:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545865.278437:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454975360 00000100:00100000:3.0:1789545865.278455:0:15111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454975360 00000100:00100000:3.0:1789545865.278568:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1789545865.278575:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789545865.278583:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454975360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789545865.278638:0:15111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789545865.278752:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454975360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 173us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545865.278761:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789545865.278832:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be3a9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454975360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789545865.279422:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789545865.279623:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454975616:0@lo:400:kworker.0 00000100:00100000:3.0:1789545865.279793:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545865.279833:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789545865.279859:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454975744:0@lo:400:kworker.0 00000100:00100000:3.0:1789545865.279889:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545865.279927:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454975744 00000100:00100000:3.0:1789545865.279954:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454975744 00000100:00100000:3.0:1789545865.280006:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789545865.280016:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454975744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545865.280070:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454975744:12345-0@lo:400:kworker.0 Request processed in 55us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545865.280078:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789545865.280124:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454975744:0@lo:400:kworker.0 00000100:00100000:1.0:1789545865.280407:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454975616 00000100:00100000:1.0:1789545865.280413:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454975616 00000100:00100000:1.0:1789545865.280476:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789545865.280485:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454975616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789545865.285278:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454975616:12345-0@lo:400:kworker.0 Request processed in 4780us (5471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545865.285298:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789545865.285353:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789545865.285390:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454975616:0@lo:400:kworker.0 00000100:00100000:1.0:1789545865.285401:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876474454975872:0@lo:400:kworker.0 00000100:00100000:1.0:1789545865.285452:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545865.285511:0:15758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454975872 00000100:00100000:3.0:1789545865.285523:0:15758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454975872 00000100:00080000:1.0:1789545865.285574:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789545865.285612:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789545865.285624:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876474454975872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545865.285909:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876474454975872:12345-0@lo:400:kworker.0 Request processed in 287us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545865.285918:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789545865.287038:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6de5819a-62ff-4f85-af03-c287b54b27c1:3311:1876474454975488:0@lo:400:kworker.0 00000100:00100000:1.0:1789545865.287253:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876474454975872:0@lo:400:kworker.0 00000100:00100000:0.0:1789545865.288994:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545865.289089:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bc9c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454976000:0@lo:400:kworker.0 00000100:00100000:2.0:1789545865.289149:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454975488 00000100:00100000:2.0:1789545865.289161:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454975488 00000100:00100000:1.0:1789545865.289180:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545865.289229:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789545865.289246:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be41ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+19:3311:x1876474454975488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789545865.289341:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be41ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+19:3311:x1876474454975488:12345-0@lo:400:kworker.0 Request processed in 103us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545865.289349:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789545865.289550:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6de5819a-62ff-4f85-af03-c287b54b27c1:3311:1876474454975488:0@lo:400:kworker.0 00000100:00100000:0.0:1789545865.289993:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454976000 00000100:00100000:0.0:1789545865.290003:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454976000 00000100:00100000:0.0:1789545865.290070:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789545865.290079:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454976000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545865.290146:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454976000:12345-0@lo:400:kworker.0 Request processed in 69us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545865.290152:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789545865.290232:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bc9c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454976000:0@lo:400:kworker.0 00000100:00080000:1.0:1789545865.292865:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789545865.327195:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545865.327303:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438211328 00000100:00100000:3.0:1789545865.327315:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438211328 00000100:00100000:3.0:1789545865.327448:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 34 00000100:00100000:3.0:1789545865.327461:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+22:14510:x1876474438211328:12345-192.168.201.16@tcp:101:dd.0 00010000:00010000:3.0:1789545865.327506:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545865.327536:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11be00/0x64919c0f856c1bb6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5912 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545865.327683:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a000/0x64919c0f856c1bbd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545865.327733:0:14423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1b5b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58ef expref: 23 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545865.327742:0:14423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6a00/0x64919c0f856c1b70 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58f6 expref: 23 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545865.327752:0:14423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a000/0x64919c0f856c1bbd lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545865.327797:0:14423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6a00/0x64919c0f856c1b70 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58f6 expref: 23 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545865.327813:0:14423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6a00/0x64919c0f856c1b70 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58f6 expref: 23 pid: 14423 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545865.327830:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be3a9fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14423:1876474454976128:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545865.327970:0:14423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1b5b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58ef expref: 23 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545865.327980:0:14423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1b5b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58ef expref: 23 pid: 14425 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545865.327990:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be3a9ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14423:1876474454976256:192.168.201.16@tcp:104: 00000100:00100000:3.0:1789545865.328016:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfae06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789545865.333755:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545865.333788:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545865.333927:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438211456 00000100:00100000:2.0:1789545865.333948:0:14408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438211456 00010000:00010000:2.0:1789545865.334002:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6a00/0x64919c0f856c1b70 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58f6 expref: 24 pid: 14423 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545865.334040:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438211584 00000100:00100000:2.0:1789545865.334043:0:14408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438211584 00010000:00010000:2.0:1789545865.334052:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1b5b lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58ef expref: 25 pid: 14425 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545865.334067:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11 00000100:00100000:2.0:1789545865.334077:0:14408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994beddef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+25:2358:x1876474438211456:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789545865.334095:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545865.334103:0:14408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6a00/0x64919c0f856c1b70 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58f6 expref: 25 pid: 14423 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545865.334142:0:14408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6a00/0x64919c0f856c1b70 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58f6 expref: 25 pid: 14423 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545865.334166:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994bc53dc500) 00010000:00010000:2.0:1789545865.334172:0:14408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a000/0x64919c0f856c1bbd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545865.334180:0:14408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a000/0x64919c0f856c1bbd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545865.334184:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789545865.334248:0:14408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994beddef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+25:2358:x1876474438211456:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 171us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545865.334255:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11 00000100:00100000:2.0:1789545865.334325:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12 00000100:00100000:2.0:1789545865.334332:0:14408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+24:2358:x1876474438211584:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789545865.334340:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545865.334345:0:14408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1b5b lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58ef expref: 24 pid: 14425 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545865.334355:0:14408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1b5b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58ef expref: 24 pid: 14425 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545865.334394:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994bc53dc500) 00010000:00010000:2.0:1789545865.334398:0:14408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a000/0x64919c0f856c1bbd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545865.334418:0:14408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a000/0x64919c0f856c1bbd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545865.334427:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a000/0x64919c0f856c1bbd lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545865.334463:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789545865.334481:0:14408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+24:2358:x1876474438211584:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 150us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545865.334596:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12 00010000:00010000:3.0:1789545865.335023:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6a00/0x64919c0f856c1b70 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58f6 expref: 23 pid: 14423 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545865.335060:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be3a9fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14423:1876474454976128:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545865.335077:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1b5b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de58ef expref: 22 pid: 14425 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545865.335092:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be3a9ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14423:1876474454976256:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545865.335123:0:14423:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a000/0x64919c0f856c1bbd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545865.335134:0:14423:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a000/0x64919c0f856c1bbd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545865.335140:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a000/0x64919c0f856c1bbd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545865.335163:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789545865.335555:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11be00/0x64919c0f856c1bb6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5912 expref: 23 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545865.335575:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a000/0x64919c0f856c1bbd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5912 expref: 22 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545865.335586:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994bc53dc500) 00010000:00010000:3.0:1789545865.335589:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789545865.335592:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bee11a000, rc 0) 00000100:00100000:3.0:1789545865.335640:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+22:14510:x1876474438211328:12345-192.168.201.16@tcp:101:dd.0 Request processed in 8181us (8459us total) trans 8589934609 rc 0/0 00000100:00100000:3.0:1789545865.335671:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 34 00000040:00080000:1.0:1789545865.341085:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789545865.342777:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545865.342949:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438211840 00000100:00100000:0.0:1789545865.342964:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438211840 00000100:00100000:0.0:1789545865.343047:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 35 00000100:00100000:0.0:1789545865.343061:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+22:14510:x1876474438211840:12345-192.168.201.16@tcp:36:dd.0 00010000:00010000:0.0:1789545865.343478:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1bcb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545865.343746:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1bcb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545865.343762:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1bcb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789545865.343840:0:14424:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934610 00000004:00010000:0.0:1789545865.343889:0:14424:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f52e9aaa reply state 00000000dc39710f transno 8589934611 ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1bcb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545865.343899:0:14424:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789545865.344192:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+25:14510:x1876474438211840:12345-192.168.201.16@tcp:36:dd.0 Request processed in 1132us (1425us total) trans 8589934611 rc 0/0 00000100:00100000:0.0:1789545865.344219:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 35 00000020:00080000:0.0:1789545865.344226:0:14424:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789545865.346960:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1bcb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545865.346986:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1bcb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545865.346995:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1bcb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545865.347002:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb7000 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545865.347007:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1bcb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545865.347016:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1bcb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545865.347038:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994bc53dc500) 00010000:00010000:0.0:1789545865.347041:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545865.347048:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1bcb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545865.347053:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1bcb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545865.349343:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545865.349904:0:15758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438211968 00000100:00100000:0.0:1789545865.349918:0:15758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438211968 00000100:00100000:0.0:1789545865.350074:0:15758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 36 00000100:00100000:0.0:1789545865.350086:0:15758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84de17c6-8992-45bc-9c05-8b5bb276e0bb+24:14510:x1876474438211968:12345-192.168.201.16@tcp:101:dd.0 00010000:00010000:0.0:1789545865.350137:0:15758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545865.350163:0:15758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c1bd2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5919 expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545865.350240:0:15758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c1bd2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5919 expref: 25 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545865.350257:0:15758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c1bd2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5919 expref: 25 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545865.350280:0:15758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994bc53dc500) 00010000:00010000:0.0:1789545865.350284:0:15758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789545865.350288:0:15758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb6200, rc 0) 00000100:00100000:0.0:1789545865.350356:0:15758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84de17c6-8992-45bc-9c05-8b5bb276e0bb+25:14510:x1876474438211968:12345-192.168.201.16@tcp:101:dd.0 Request processed in 272us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545865.350385:0:15758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 36 00000100:00100000:2.0:1789545865.363070:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545865.363175:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438212224 00000100:00100000:1.0:1789545865.363189:0:14408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438212224 00000100:00100000:1.0:1789545865.363321:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2 00000100:00100000:1.0:1789545865.363351:0:14408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+25:14510:x1876474438212224:12345-192.168.201.16@tcp:103:dd.0 00010000:00010000:1.0:1789545865.363410:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789545865.363454:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c1bd2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5919 expref: 25 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545865.363480:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994bc53dc500) 00010000:00010000:1.0:1789545865.363487:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789545865.363565:0:14408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+24:14510:x1876474438212224:12345-192.168.201.16@tcp:103:dd.0 Request processed in 217us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545865.363574:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2 00000100:00100000:2.0:1789545865.365972:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545865.366170:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438212352 00000100:00100000:3.0:1789545865.366182:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438212352 00000100:00100000:3.0:1789545865.366258:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 37 00000100:00100000:3.0:1789545865.366272:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+24:14510:x1876474438212352:12345-192.168.201.16@tcp:58:dd.0 00010000:00010000:3.0:1789545865.366446:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11be00/0x64919c0f856c1bd9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545865.366469:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11be00/0x64919c0f856c1bd9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545865.366483:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11be00/0x64919c0f856c1bd9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789545865.368258:0:14425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789545865.369175:0:14425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789545865.369260:0:14425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789545865.369751:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+24:14510:x1876474438212352:12345-192.168.201.16@tcp:58:dd.0 Request processed in 3473us (3782us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545865.369767:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 37 00000100:00100000:3.0:1789545865.372746:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545865.372862:0:15758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438212480 00000100:00100000:0.0:1789545865.372876:0:15758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438212480 00000100:00100000:0.0:1789545865.373042:0:15758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 38 00000100:00100000:0.0:1789545865.373054:0:15758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84de17c6-8992-45bc-9c05-8b5bb276e0bb+24:14510:x1876474438212480:12345-192.168.201.16@tcp:101:dd.0 00010000:00010000:0.0:1789545865.373084:0:15758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545865.373113:0:15758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1be0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5920 expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545865.373189:0:15758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11be00/0x64919c0f856c1bd9 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545865.373201:0:15758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1be0 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5920 expref: 25 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545865.373244:0:15758:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11be00/0x64919c0f856c1bd9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545865.373262:0:15758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1be0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5920 expref: 25 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545865.373277:0:15758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994bc53dc500) 00010000:00010000:0.0:1789545865.373280:0:15758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789545865.373285:0:15758:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1be0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5920 expref: 25 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545865.373294:0:15758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb7000, rc 0) 00000100:00100000:0.0:1789545865.373563:0:15758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84de17c6-8992-45bc-9c05-8b5bb276e0bb+25:14510:x1876474438212480:12345-192.168.201.16@tcp:101:dd.0 Request processed in 510us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545865.373572:0:15758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 38 00010000:00010000:0.0:1789545865.860278:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789545865.878201:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000001:00080000:2.0:1789545865.878235:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:2.0:1789545865.878268:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000040:00080000:1.0:1789545866.365921:0:14457:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789545866.365938:0:14457:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789545866.366144:0:14457:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789545866.366154:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789545866.366353:0:14457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be479ad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14457:1876474454976384:192.168.201.16@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789545866.366522:0:14457:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc9ee16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789545866.389471:0:14457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be479ad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14457:1876474454976384:192.168.201.16@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789545866.437979:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545866.440121:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438212608 00000100:00100000:0.0:1789545866.440139:0:14434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438212608 00000100:00100000:0.0:1789545866.440295:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 0 00000100:00100000:0.0:1789545866.440308:0:14434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+11:14511:x1876474438212608:12345-192.168.201.16@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789545866.440447:0:14434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+11:14511:x1876474438212608:12345-192.168.201.16@tcp:900:lhsmtool_posix.0 Request processed in 142us (2482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545866.440455:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 0 00000100:00100000:3.0:1789545866.446865:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545866.447172:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438212736 00000100:00100000:2.0:1789545866.447189:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438212736 00000100:00100000:2.0:1789545866.447288:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 39 00000100:00100000:2.0:1789545866.447300:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+11:14511:x1876474438212736:12345-192.168.201.16@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789545866.447337:0:14424:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789545866.447540:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+11:14511:x1876474438212736:12345-192.168.201.16@tcp:53:lhsmtool_posix.0 Request processed in 242us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545866.447564:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 39 00000100:00100000:2.0:1789545866.450603:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545866.450759:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438212864 00000100:00100000:3.0:1789545866.450774:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438212864 00000100:00100000:3.0:1789545866.450858:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 40 00000100:00100000:3.0:1789545866.450871:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+11:14511:x1876474438212864:12345-192.168.201.16@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789545866.450973:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a600/0x64919c0f856c1be7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.450997:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a600/0x64919c0f856c1be7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.451014:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a600/0x64919c0f856c1be7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.460178:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a200/0x64919c0f856c1bee lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.460336:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a200/0x64919c0f856c1bee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.460352:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a200/0x64919c0f856c1bee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.460416:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a400/0x64919c0f856c1bf5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.460426:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a400/0x64919c0f856c1bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.460433:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a400/0x64919c0f856c1bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545866.460496:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789545866.460502:0:14423:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789545866.460527:0:14423:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a400/0x64919c0f856c1bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.460543:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a600/0x64919c0f856c1be7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.460550:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a600/0x64919c0f856c1be7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.460560:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a600/0x64919c0f856c1be7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.460596:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bee11a600 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545866.460601:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a600/0x64919c0f856c1be7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.460610:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a600/0x64919c0f856c1be7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.460624:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff994bc4ffee00) 00010000:00010000:3.0:1789545866.460627:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545866.460632:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a600/0x64919c0f856c1be7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.460638:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a600/0x64919c0f856c1be7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.460655:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a200/0x64919c0f856c1bee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.460661:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a200/0x64919c0f856c1bee lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.460667:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a200/0x64919c0f856c1bee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.460672:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bee11a200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545866.460675:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a200/0x64919c0f856c1bee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.460681:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a200/0x64919c0f856c1bee lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.460700:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff994bc4f9e300) 00010000:00010000:3.0:1789545866.460704:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545866.460707:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a200/0x64919c0f856c1bee lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.460714:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a200/0x64919c0f856c1bee lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.460730:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a400/0x64919c0f856c1bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.460736:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a400/0x64919c0f856c1bf5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.460742:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a400/0x64919c0f856c1bf5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.460748:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bee11a400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545866.460750:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a400/0x64919c0f856c1bf5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.460756:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a400/0x64919c0f856c1bf5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.460763:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994bc53dc500) 00010000:00010000:3.0:1789545866.460765:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545866.460768:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a400/0x64919c0f856c1bf5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.460773:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a400/0x64919c0f856c1bf5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545866.462152:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+11:14511:x1876474438212864:12345-192.168.201.16@tcp:34:lhsmtool_posix.0 Request processed in 11269us (11549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545866.462171:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 40 00000100:00100000:3.0:1789545866.465922:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545866.466664:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438213120 00000100:00100000:2.0:1789545866.466679:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438213120 00000100:00100000:2.0:1789545866.466765:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 41 00000100:00100000:2.0:1789545866.466778:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be3a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+11:14511:x1876474438213120:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789545866.466807:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545866.466845:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9a00/0x64919c0f856c1bfc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5927 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545866.466992:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1c03 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545866.467014:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1c03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545866.467030:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1c03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789545866.467045:0:14424:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789545866.467879:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1c03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545866.467894:0:14424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1c03 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545866.467926:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1c03 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545866.467933:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994ac2be8c00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545866.467937:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1c03 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545866.467946:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1c03 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545866.467962:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994bc53dc500) 00010000:00010000:2.0:1789545866.467965:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789545866.467970:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1c03 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545866.467976:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8c00/0x64919c0f856c1c03 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545866.468037:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9a00/0x64919c0f856c1bfc lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5927 expref: 13 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545866.468048:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff994bc4ffee00) 00010000:00010000:2.0:1789545866.468050:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789545866.468054:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be9a00/0x64919c0f856c1bfc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5927 expref: 13 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545866.468066:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994ac2be9a00, rc 0) 00000100:00100000:2.0:1789545866.468152:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be3a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+12:14511:x1876474438213120:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 1375us (2243us total) trans 8589934612 rc 301/301 00000100:00100000:2.0:1789545866.468170:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 41 00000100:00100000:2.0:1789545866.481066:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545866.481711:0:15758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438213248 00000100:00100000:0.0:1789545866.481726:0:15758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438213248 00000100:00100000:0.0:1789545866.481807:0:15758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 42 00000100:00100000:0.0:1789545866.481876:0:15758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84de17c6-8992-45bc-9c05-8b5bb276e0bb+12:14511:x1876474438213248:12345-192.168.201.16@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789545866.481929:0:15758:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789545866.482075:0:15758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84de17c6-8992-45bc-9c05-8b5bb276e0bb+12:14511:x1876474438213248:12345-192.168.201.16@tcp:53:lhsmtool_posix.0 Request processed in 202us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545866.482084:0:15758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 42 00000100:00100000:1.0:1789545866.488493:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545866.488678:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438213504 00000100:00100000:0.0:1789545866.488693:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438213504 00000100:00100000:0.0:1789545866.488778:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 43 00000100:00100000:0.0:1789545866.488790:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be479ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+12:14511:x1876474438213504:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789545866.489015:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789545866.489045:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c1c11 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de592e expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789545866.490978:0:14425:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:0.0:1789545866.490991:0:14425:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:0.0:1789545866.491052:0:14425:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1789545866.492397:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c1c18 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.492428:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c1c18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.492444:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c1c18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.492547:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c1c11 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de592e expref: 15 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.492593:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c1c18 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de592e expref: 14 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.492604:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff994bc4f11c00) 00010000:00010000:0.0:1789545866.492608:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789545866.492612:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994be4eb6800, rc 0) 00000100:00100000:0.0:1789545866.492718:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be479ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+14:14511:x1876474438213504:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 3928us (4247us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1789545866.492730:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 43 00000100:00100000:1.0:1789545866.503316:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545866.503432:0:15758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438213760 00000100:00100000:0.0:1789545866.503445:0:15758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438213760 00000100:00100000:0.0:1789545866.503883:0:15758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 44 00000100:00100000:0.0:1789545866.503898:0:15758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be479a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84de17c6-8992-45bc-9c05-8b5bb276e0bb+14:14511:x1876474438213760:12345-192.168.201.16@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789545866.503982:0:15758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789545866.504018:0:15758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6800/0x64919c0f856c1c18 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de592e expref: 14 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.504044:0:15758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff994bc4f11c00) 00010000:00010000:0.0:1789545866.504059:0:15758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789545866.504088:0:15758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c1c26 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.504106:0:15758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c1c26 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.504119:0:15758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c1c26 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.504161:0:15758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c1c2d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf6c116cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.504169:0:15758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c1c2d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf6c116cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.504177:0:15758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c1c2d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf6c116cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.505230:0:15758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c1c26 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.505248:0:15758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c1c26 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.505257:0:15758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c1c26 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.505998:0:15758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb7800 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545866.506006:0:15758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c1c26 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.506016:0:15758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c1c26 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.506038:0:15758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff994bc53dc000) 00010000:00010000:0.0:1789545866.506042:0:15758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545866.506048:0:15758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c1c26 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.506056:0:15758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7800/0x64919c0f856c1c26 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.506094:0:15758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c1c2d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf6c116cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.506102:0:15758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c1c2d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf6c116cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.506108:0:15758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c1c2d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf6c116cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.506113:0:15758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:0.0:1789545866.506117:0:15758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c1c2d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf6c116cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.506123:0:15758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c1c2d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf6c116cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.506131:0:15758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xf6c116cb (ffff994bc4f11200) 00010000:00010000:0.0:1789545866.506134:0:15758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789545866.506137:0:15758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c1c2d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf6c116cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.506143:0:15758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6200/0x64919c0f856c1c2d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf6c116cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545866.507041:0:15758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be479a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84de17c6-8992-45bc-9c05-8b5bb276e0bb+13:14511:x1876474438213760:12345-192.168.201.16@tcp:36:lhsmtool_posix.0 Request processed in 3137us (3731us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789545866.507056:0:15758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 44 00000100:00100000:2.0:1789545866.514057:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545866.515880:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438213888 00000100:00100000:3.0:1789545866.515900:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438213888 00000100:00100000:3.0:1789545866.515984:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 45 00000100:00100000:3.0:1789545866.515995:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+13:14511:x1876474438213888:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789545866.516022:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545866.516051:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b600/0x64919c0f856c1c34 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5935 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.516094:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a400/0x64919c0f856c1c3b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.516110:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a400/0x64919c0f856c1c3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.516124:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a400/0x64919c0f856c1c3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.516252:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b600/0x64919c0f856c1c34 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5935 expref: 15 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.516280:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a400/0x64919c0f856c1c3b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5935 expref: 14 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.516290:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff994bc4f9e300) 00010000:00010000:3.0:1789545866.516294:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789545866.516299:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bee11a400, rc 0) 00000100:00100000:3.0:1789545866.516401:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+14:14511:x1876474438213888:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 406us (2359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545866.516602:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 45 00000100:00100000:2.0:1789545866.538021:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545866.538137:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438214144 00000100:00100000:1.0:1789545866.538152:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438214144 00000100:00100000:1.0:1789545866.538245:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 46 00000100:00100000:1.0:1789545866.538266:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+14:14511:x1876474438214144:12345-192.168.201.16@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789545866.538438:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1c42 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545866.538496:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1c42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545866.538512:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1c42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789545866.540150:0:14423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1789545866.540171:0:14423:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 480462810795ns, next at 481462807206ns, rc = 0 00000004:00010000:1.0:1789545866.541013:0:14423:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b98e92a4 reply state 00000000fe9c5eff transno 8589934614 ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1c42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545866.541030:0:14423:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789545866.541184:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+16:14511:x1876474438214144:12345-192.168.201.16@tcp:36:lhsmtool_posix.0 Request processed in 2924us (3175us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1789545866.541332:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 46 00000100:00100000:3.0:1789545866.549859:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545866.549945:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438214272 00000100:00100000:1.0:1789545866.549959:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438214272 00000100:00100000:1.0:1789545866.550042:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 47 00000100:00100000:1.0:1789545866.550055:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+16:14511:x1876474438214272:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789545866.550089:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789545866.550117:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1c49 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de593c expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545866.550211:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1c49 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de593c expref: 17 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545866.550230:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1c49 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de593c expref: 17 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545866.550278:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff994bc4f9e300) 00010000:00010000:1.0:1789545866.550281:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789545866.550286:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bc49d0000, rc 0) 00000100:00100000:1.0:1789545866.550386:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+17:14511:x1876474438214272:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 333us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545866.550394:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 47 00010000:00010000:2.0:1789545866.550649:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1c42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545866.550660:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1c42 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545866.550669:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1c42 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545866.550677:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1c00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:2.0:1789545866.550683:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1c42 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545866.550693:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1c42 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545866.550708:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff994bc4f9e300) 00010000:00010000:2.0:1789545866.550710:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789545866.550714:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1c42 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545866.550721:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d1c00/0x64919c0f856c1c42 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545866.560329:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545866.560598:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438214400 00000100:00100000:3.0:1789545866.560612:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438214400 00000100:00100000:3.0:1789545866.560702:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12 00000100:00100000:3.0:1789545866.560715:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be479a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+5:2358:x1876474438214400:12345-192.168.201.16@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1789545866.561216:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789545866.563955:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be479a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+6:2358:x1876474438214400:12345-192.168.201.16@tcp:2:lhsmtool_posix.0 Request processed in 3226us (3623us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789545866.563976:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12 00000100:00100000:2.0:1789545866.577437:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545866.577572:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438214656 00000100:00100000:0.0:1789545866.577593:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438214656 00000100:00100000:0.0:1789545866.577665:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9 00000100:00100000:0.0:1789545866.577696:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bc9c1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+16:14511:x1876474438214656:12345-192.168.201.16@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789545866.578021:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bc9c1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+17:14511:x1876474438214656:12345-192.168.201.16@tcp:35:lhsmtool_posix.0 Request processed in 328us (600us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1789545866.578030:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9 00000100:00100000:2.0:1789545866.584891:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545866.585259:0:15758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438214912 00000100:00100000:0.0:1789545866.585275:0:15758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438214912 00000100:00100000:0.0:1789545866.585407:0:15758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 48 00000100:00100000:0.0:1789545866.585420:0:15758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be76c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84de17c6-8992-45bc-9c05-8b5bb276e0bb+17:14511:x1876474438214912:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789545866.585596:0:15758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be76c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84de17c6-8992-45bc-9c05-8b5bb276e0bb+17:14511:x1876474438214912:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 Request processed in 178us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545866.585604:0:15758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 48 00000100:00100000:1.0:1789545866.605920:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545866.606162:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438215040 00000100:00100000:3.0:1789545866.606177:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438215040 00000100:00100000:3.0:1789545866.606270:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 49 00000100:00100000:3.0:1789545866.606283:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+17:14511:x1876474438215040:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789545866.606313:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545866.606342:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b600/0x64919c0f856c1c50 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5943 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.606485:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a200/0x64919c0f856c1c57 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.606504:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a200/0x64919c0f856c1c57 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.606518:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a200/0x64919c0f856c1c57 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789545866.606576:0:14424:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789545866.606870:0:14424:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a200/0x64919c0f856c1c57 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.606908:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b600/0x64919c0f856c1c50 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5943 expref: 19 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.606930:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a200/0x64919c0f856c1c57 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5943 expref: 18 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.606941:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff994bc4f9e300) 00010000:00010000:3.0:1789545866.606944:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789545866.606949:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bee11a200, rc 0) 00000100:00100000:3.0:1789545866.607036:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+18:14511:x1876474438215040:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 755us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545866.607044:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 49 00000100:00100000:2.0:1789545866.620557:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545866.620779:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438215168 00000100:00100000:3.0:1789545866.620794:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438215168 00000100:00100000:3.0:1789545866.620881:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 13 00000100:00100000:3.0:1789545866.620894:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+6:2359:x1876474438215168:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789545866.620920:0:15107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789545866.620948:0:15107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ab18f51/0x64919c0f856c1c5e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de594a expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789545866.620985:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aaa4d8a, blocks: 0x1 00010000:00010000:3.0:1789545866.621012:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1789545866.621017:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789545866.621029:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ab18f51/0x64919c0f856c1c5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de594a expref: 7 pid: 15107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.621078:0:15107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007ab18f51/0x64919c0f856c1c5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de594a expref: 7 pid: 15107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.621097:0:15107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994bee11b600, rc 0) 00000100:00100000:3.0:1789545866.621182:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+7:2359:x1876474438215168:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 290us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545866.621190:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 13 00000100:00100000:2.0:1789545866.627062:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545866.630984:0:15758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438215424 00000100:00100000:0.0:1789545866.631009:0:15758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438215424 00000100:00100000:1.0:1789545866.631244:0:15758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 50 00000100:00100000:1.0:1789545866.631870:0:15758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84de17c6-8992-45bc-9c05-8b5bb276e0bb+18:14511:x1876474438215424:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789545866.632084:0:15758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84de17c6-8992-45bc-9c05-8b5bb276e0bb+18:14511:x1876474438215424:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 Request processed in 828us (5036us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545866.632095:0:15758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 50 00000100:00100000:2.0:1789545866.639697:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545866.639873:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438215552 00000100:00100000:3.0:1789545866.639888:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438215552 00000100:00100000:3.0:1789545866.639965:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 51 00000100:00100000:3.0:1789545866.639977:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+18:14511:x1876474438215552:12345-192.168.201.16@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1789545866.676669:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+18:14511:x1876474438215552:12345-192.168.201.16@tcp:44:lhsmtool_posix.0 Request processed in 36676us (36969us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545866.676686:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 51 00000001:00080000:2.0:1789545866.677015:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934615 is committed 00000004:00080000:2.0:1789545866.677034:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1789545866.678434:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454976512:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789545866.678518:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789545866.678730:0:16051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454976512 00000100:00100000:2.0:1789545866.678741:0:16051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454976512 00000100:00100000:2.0:1789545866.678813:0:16051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789545866.678834:0:16051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454976512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789545866.679065:0:16051:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789545866.679070:0:16051:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789545866.679072:0:16051:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789545866.679075:0:16051:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789545866 -> 1789545866 00002000:00010000:2.0:1789545866.679077:0:16051:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789545866.679137:0:16051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1876474454976512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 314us (619us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1789545866.679144:0:16051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:2.0:1789545866.679202:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff994be4b3f100/2, rc 0, transno 8589934595 00000100:00100000:2.0:1789545866.679209:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454976512:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789545866.681038:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545866.684950:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438215680 00000100:00100000:3.0:1789545866.684974:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438215680 00000100:00100000:3.0:1789545866.685078:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 15 00000100:00100000:3.0:1789545866.685093:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+7:2361:x1876474438215680:12345-192.168.201.16@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789545866.685980:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+7:2361:x1876474438215680:12345-192.168.201.16@tcp:16:lhsmtool_posix.0 Request processed in 882us (4947us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545866.685993:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 15 00000100:00100000:0.0:1789545866.692229:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545866.695790:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438215936 00000100:00100000:2.0:1789545866.695817:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438215936 00000100:00100000:2.0:1789545866.695940:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 52 00000100:00100000:2.0:1789545866.695954:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+14:14511:x1876474438215936:12345-192.168.201.16@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789545866.696028:0:14423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789545866.696063:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11a200/0x64919c0f856c1c57 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5943 expref: 14 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545866.696112:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff994bc4f9e300) 00010000:00010000:2.0:1789545866.696118:0:14423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789545866.696161:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1c65 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545866.696178:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1c65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545866.696190:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1c65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789545866.696639:0:14423:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e84fd5e reply state 00000000929aa3f1 transno 8589934616 ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1c65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545866.696651:0:14423:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789545866.696798:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+15:14511:x1876474438215936:12345-192.168.201.16@tcp:36:lhsmtool_posix.0 Request processed in 845us (4584us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1789545866.696807:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 52 00000100:00100000:0.0:1789545866.702234:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545866.702437:0:16051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438216064 00000100:00100000:2.0:1789545866.702453:0:16051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438216064 00000100:00100000:2.0:1789545866.702520:0:16051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 16 00000100:00100000:2.0:1789545866.702534:0:16051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84de17c6-8992-45bc-9c05-8b5bb276e0bb+7:14511:x1876474438216064:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789545866.702562:0:16051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789545866.702590:0:16051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ead518c/0x64919c0f856c1c6c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8f1b2a6de5951 expref: -99 pid: 16051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545866.702634:0:16051:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007ab18f51/0x64919c0f856c1c5e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de594a expref: 8 pid: 15107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545866.702674:0:16051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545866.702679:0:16051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545866.702686:0:16051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ead518c/0x64919c0f856c1c6c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5951 expref: 8 pid: 16051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545866.702736:0:16051:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007ab18f51/0x64919c0f856c1c5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de594a expref: 8 pid: 15107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545866.702752:0:16051:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007ab18f51/0x64919c0f856c1c5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de594a expref: 8 pid: 15107 timeout: 580 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545866.702770:0:16051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfb43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16051:1876474454976640:192.168.201.16@tcp:104: 00000100:00100000:2.0:1789545866.702882:0:16051:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfadcf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789545866.706866:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545866.707000:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438216192 00000100:00100000:0.0:1789545866.707012:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438216192 00010000:00010000:0.0:1789545866.707063:0:14409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007ab18f51/0x64919c0f856c1c5e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de594a expref: 9 pid: 15107 timeout: 580 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545866.707119:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 13 00000100:00100000:0.0:1789545866.707132:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+9:2359:x1876474438216192:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789545866.707151:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789545866.707197:0:14409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007ab18f51/0x64919c0f856c1c5e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de594a expref: 9 pid: 15107 timeout: 580 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.707214:0:14409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007ab18f51/0x64919c0f856c1c5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de594a expref: 9 pid: 15107 timeout: 580 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.707248:0:14409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789545866.707253:0:14409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789545866.707270:0:14409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002ead518c/0x64919c0f856c1c6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5951 expref: 9 pid: 16051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.707282:0:14409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ead518c/0x64919c0f856c1c6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5951 expref: 9 pid: 16051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.707331:0:14409:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002ead518c/0x64919c0f856c1c6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5951 expref: 9 pid: 16051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545866.707348:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfc53100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14409:1876474454976768:192.168.201.16@tcp:105: 00000100:00100000:0.0:1789545866.707490:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc596dc00 going to sleep for 11 seconds 00010000:00010000:3.0:1789545866.709012:0:16051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ab18f51/0x64919c0f856c1c5e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de594a expref: 9 pid: 15107 timeout: 580 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545866.709064:0:16051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfb43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16051:1876474454976640:192.168.201.16@tcp:104: 00010000:00010000:3.0:1789545866.709102:0:16051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002ead518c/0x64919c0f856c1c6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5951 expref: 8 pid: 16051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.709118:0:16051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994ac2be8a00, rc 0) 00000100:00100000:3.0:1789545866.709195:0:16051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84de17c6-8992-45bc-9c05-8b5bb276e0bb+8:14511:x1876474438216064:12345-192.168.201.16@tcp:101:lhsmtool_posix.0 Request processed in 6663us (6975us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545866.709206:0:16051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 16 00010000:00010000:1.0:1789545866.712715:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1c65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545866.712738:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1c65 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545866.712746:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1c65 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545866.712753:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994ac2be8200 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:1.0:1789545866.712759:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1c65 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545866.712792:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1c65 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545866.712834:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff994bc4f9e300) 00010000:00010000:1.0:1789545866.712838:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789545866.712845:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1c65 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545866.712852:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994ac2be8200/0x64919c0f856c1c65 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545866.715125:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfc53100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14409:1876474454976768:192.168.201.16@tcp:105: 00010000:00010000:0.0:1789545866.715166:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789545866.715239:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+7:2359:x1876474438216192:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 8108us (8384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545866.715253:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 13 00000100:00100000:2.0:1789545866.719717:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545866.719832:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438216320 00000100:00100000:3.0:1789545866.719846:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438216320 00000100:00100000:3.0:1789545866.719916:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 17 00000100:00100000:3.0:1789545866.719928:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+7:2359:x1876474438216320:12345-192.168.201.16@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789545866.720184:0:15107:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789545866.720188:0:15107:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789545865 00002000:00010000:3.0:1789545866.720191:0:15107:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789545864 00002000:00010000:3.0:1789545866.720194:0:15107:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789545866 -> 1789545865 00002000:00010000:3.0:1789545866.720196:0:15107:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789545866.720274:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+8:2359:x1876474438216320:12345-192.168.201.16@tcp:2:lhsmtool_posix.0 Request processed in 348us (569us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789545866.720282:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 17 00000100:00100000:2.0:1789545866.723548:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545866.723676:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438216448 00000100:00100000:0.0:1789545866.723689:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438216448 00000100:00100000:0.0:1789545866.723775:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 18 00000100:00100000:0.0:1789545866.723786:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+8:2360:x1876474438216448:12345-192.168.201.16@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789545866.723869:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000712e86a3/0x64919c0f856c1c73 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.723897:0:15109:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002ead518c/0x64919c0f856c1c6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5951 expref: 8 pid: 16051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.723908:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789545866.723913:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789545866.723918:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000712e86a3/0x64919c0f856c1c73 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.723966:0:15109:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002ead518c/0x64919c0f856c1c6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5951 expref: 8 pid: 16051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.723981:0:15109:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002ead518c/0x64919c0f856c1c6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5951 expref: 8 pid: 16051 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545866.723999:0:15109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfc53100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15109:1876474454976896:192.168.201.16@tcp:104: 00000100:00100000:0.0:1789545866.724114:0:15109:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bc596dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789545866.728168:0:15109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfc53100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15109:1876474454976896:192.168.201.16@tcp:104: 00010000:00010000:0.0:1789545866.728228:0:15109:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000712e86a3/0x64919c0f856c1c73 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789545866.729735:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545866.729861:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438216576 00000100:00100000:0.0:1789545866.729874:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438216576 00010000:00010000:0.0:1789545866.729929:0:14410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002ead518c/0x64919c0f856c1c6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5951 expref: 9 pid: 16051 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545866.729982:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 14 00000100:00100000:0.0:1789545866.729993:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+9:2359:x1876474438216576:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789545866.730014:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789545866.730044:0:14410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002ead518c/0x64919c0f856c1c6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5951 expref: 9 pid: 16051 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.730062:0:14410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002ead518c/0x64919c0f856c1c6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5951 expref: 9 pid: 16051 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.730092:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ead518c/0x64919c0f856c1c6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5951 expref: 9 pid: 16051 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.730119:0:14410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789545866.730125:0:14410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789545866.730132:0:14410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000712e86a3/0x64919c0f856c1c73 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.730144:0:14410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000712e86a3/0x64919c0f856c1c73 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.730205:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789545866.730279:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+8:2359:x1876474438216576:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 286us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545866.730289:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 14 00010000:00010000:3.0:1789545866.731088:0:15109:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000712e86a3/0x64919c0f856c1c73 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.731121:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000712e86a3/0x64919c0f856c1c73 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.731157:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000712e86a3/0x64919c0f856c1c73 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.731166:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000712e86a3/0x64919c0f856c1c73 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.731175:0:15109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000712e86a3/0x64919c0f856c1c73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.731182:0:15109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6800 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545866.731188:0:15109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000712e86a3/0x64919c0f856c1c73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.731199:0:15109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000712e86a3/0x64919c0f856c1c73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.731216:0:15109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000712e86a3/0x64919c0f856c1c73 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.731226:0:15109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000712e86a3/0x64919c0f856c1c73 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545866.731327:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+7:2360:x1876474438216448:12345-192.168.201.16@tcp:1:lhsmtool_posix.0 Request processed in 7540us (7791us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545866.731337:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 18 00000100:00100000:2.0:1789545866.736176:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545866.736296:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438216832 00000100:00100000:0.0:1789545866.736310:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438216832 00000100:00100000:0.0:1789545866.736734:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 53 00000100:00100000:0.0:1789545866.736750:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+14:14511:x1876474438216832:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789545866.736904:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6a00/0x64919c0f856c1c7a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.736928:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6a00/0x64919c0f856c1c7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.736943:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6a00/0x64919c0f856c1c7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.737286:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c1c81 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.737301:0:14425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1c49 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de593c expref: 15 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.737310:0:14425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c1c81 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.737353:0:14425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1c49 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de593c expref: 15 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.737425:0:14425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1c49 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de593c expref: 15 pid: 14424 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545866.737445:0:14425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfc53100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14425:1876474454977024:192.168.201.16@tcp:104: 00000100:00100000:0.0:1789545866.737565:0:14425:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8c6ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1789545866.743896:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545866.744422:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438216960 00000100:00100000:3.0:1789545866.744437:0:14458:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438216960 00010000:00010000:3.0:1789545866.744503:0:14458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1c49 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de593c expref: 16 pid: 14424 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545866.744551:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 15 00000100:00100000:3.0:1789545866.744565:0:14458:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be4799f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84de17c6-8992-45bc-9c05-8b5bb276e0bb+16:2358:x1876474438216960:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789545866.744584:0:14458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789545866.744593:0:14458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1c49 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de593c expref: 16 pid: 14424 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.744608:0:14458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1c49 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de593c expref: 16 pid: 14424 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.744650:0:14458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff994bc4f9e300) 00010000:00010000:3.0:1789545866.744656:0:14458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c1c81 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.744668:0:14458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c1c81 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.744677:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c1c81 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.744725:0:14458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789545866.744797:0:14458:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be4799f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84de17c6-8992-45bc-9c05-8b5bb276e0bb+16:2358:x1876474438216960:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 235us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545866.744805:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 15 00010000:00010000:0.0:1789545866.746315:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bc49d0000/0x64919c0f856c1c49 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de593c expref: 15 pid: 14424 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545866.746348:0:14425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfc53100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14425:1876474454977024:192.168.201.16@tcp:104: 00010000:00010000:0.0:1789545866.746450:0:14425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c1c81 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.746462:0:14425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c1c81 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.746469:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c1c81 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789545866.746783:0:14425:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1789545866.747286:0:14425:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000001:00080000:0.0:1789545866.747339:0:14425:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1789545866.747517:0:14425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdfc53100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14425:1876474454977152:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789545866.747635:0:14425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545866.747675:0:14425:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bd8c6ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1789545866.748090:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454977152 00000100:00100000:1.0:1789545866.748100:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454977152 00000100:00100000:1.0:1789545866.748164:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789545866.748176:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14425:x1876474454977152:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789545866.748296:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14425:x1876474454977152:12345-0@lo:1000:mdt00_002.0 Request processed in 121us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789545866.748304:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789545866.748616:0:14425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdfc53100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14425:1876474454977152:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1789545866.749481:0:14425:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934620 00000100:00100000:3.0:1789545866.749581:0:14425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4b3c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14425:1876474454977280:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789545866.749640:0:14425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545866.749678:0:14425:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfae0240 going to sleep for 11 seconds 00000100:00100000:1.0:1789545866.749852:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454977280 00000100:00100000:1.0:1789545866.749860:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454977280 00000100:00100000:1.0:1789545866.749914:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789545866.749924:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14425:x1876474454977280:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789545866.750103:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14425:x1876474454977280:12345-0@lo:1000:mdt00_002.0 Request processed in 179us (461us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789545866.750111:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789545866.750813:0:14425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4b3c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14425:1876474454977280:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1789545866.750882:0:14425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c1c81 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.750894:0:14425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c1c81 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.750902:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c1c81 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.750909:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6400 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545866.750914:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c1c81 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.750923:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c1c81 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.750942:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff994bc4f9e300) 00010000:00010000:3.0:1789545866.750946:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789545866.750973:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c1c81 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.750980:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6400/0x64919c0f856c1c81 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.751023:0:14425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11be00/0x64919c0f856c1bd9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.751030:0:14425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11be00/0x64919c0f856c1bd9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.751035:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11be00/0x64919c0f856c1bd9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.751040:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bee11be00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545866.751043:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11be00/0x64919c0f856c1bd9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.751048:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11be00/0x64919c0f856c1bd9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.751056:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994bc53dc500) 00010000:00010000:3.0:1789545866.751058:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789545866.751067:0:14425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1be0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5920 expref: 18 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.751080:0:14425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1be0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5920 expref: 18 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.751090:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1be0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5920 expref: 18 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.751142:0:14425:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7000/0x64919c0f856c1be0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xaf8f1b2a6de5920 expref: 18 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545866.751157:0:14425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be5192a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14425:1876474454977408:192.168.201.16@tcp:105: 00000100:00100000:3.0:1789545866.751292:0:14425:0:(client.c:2716:ptlrpc_set_wait()) set ffff994bdfae0240 going to sleep for 11 seconds 00000100:00100000:1.0:1789545866.756698:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545866.756858:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438217088 00000100:00100000:0.0:1789545866.756870:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438217088 00000100:00100000:0.0:1789545866.756949:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10 00000100:00100000:0.0:1789545866.756979:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf993050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+19:14510:x1876474438217088:12345-192.168.201.16@tcp:49:dd.0 00000100:00100000:0.0:1789545866.757149:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf993050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+19:14510:x1876474438217088:12345-192.168.201.16@tcp:49:dd.0 Request processed in 172us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545866.757158:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10 00000100:00100000:3.0:1789545866.758158:0:14425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be5192a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14425:1876474454977408:192.168.201.16@tcp:105: 00010000:00010000:3.0:1789545866.758195:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11be00/0x64919c0f856c1bd9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.758207:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11be00/0x64919c0f856c1bd9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.758247:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b600/0x64919c0f856c1c88 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.758265:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b600/0x64919c0f856c1c88 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.758277:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b600/0x64919c0f856c1c88 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.758288:0:14425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b600/0x64919c0f856c1c88 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.758296:0:14425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b600/0x64919c0f856c1c88 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.758303:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b600/0x64919c0f856c1c88 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.758324:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bee11b600 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545866.758329:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b600/0x64919c0f856c1c88 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.758337:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b600/0x64919c0f856c1c88 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.758351:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994bc53dc500) 00010000:00010000:3.0:1789545866.758355:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789545866.758397:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b600/0x64919c0f856c1c88 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.758404:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994bee11b600/0x64919c0f856c1c88 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.758733:0:14425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6a00/0x64919c0f856c1c7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.758739:0:14425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6a00/0x64919c0f856c1c7a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.758745:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6a00/0x64919c0f856c1c7a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.758749:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6a00 already unused, calling callback (ffffffffc212d4f0) 00010000:00010000:3.0:1789545866.758752:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6a00/0x64919c0f856c1c7a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.758758:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6a00/0x64919c0f856c1c7a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.758781:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994bc53dc500) 00010000:00010000:3.0:1789545866.758783:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789545866.758786:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6a00/0x64919c0f856c1c7a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.758792:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb6a00/0x64919c0f856c1c7a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545866.759225:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+18:14511:x1876474438216832:12345-192.168.201.16@tcp:57:lhsmtool_posix.0 Request processed in 22477us (23058us total) trans 8589934621 rc 0/0 00000100:00100000:3.0:1789545866.759238:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 53 00000020:00080000:3.0:1789545866.759245:0:14425:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1789545866.766093:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1789545866.766221:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438217344 00000100:00100000:0.0:1789545866.766236:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438217344 00000100:00100000:0.0:1789545866.766309:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11 00000100:00100000:0.0:1789545866.766322:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+18:14511:x1876474438217344:12345-192.168.201.16@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789545866.768059:0:14427:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789545866.768167:0:14427:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934622 00010000:00010000:0.0:1789545866.768231:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1c8f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.768254:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1c8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.768270:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1c8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.768282:0:14427:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1c8f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.768288:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1c8f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.768294:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1c8f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545866.768326:0:14427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789545866.768506:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84de17c6-8992-45bc-9c05-8b5bb276e0bb+20:14511:x1876474438217344:12345-192.168.201.16@tcp:35:lhsmtool_posix.0 Request processed in 2181us (2421us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1789545866.768524:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11 00000020:00080000:0.0:1789545866.768532:0:14427:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789545866.768998:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789545866.769007:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1c8f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.769018:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb7200 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:3.0:1789545866.769023:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1c8f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.769033:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1c8f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.769048:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff994bc4f9e300) 00010000:00010000:3.0:1789545866.769052:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789545866.769058:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1c8f lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.769064:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994be4eb7200/0x64919c0f856c1c8f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.769094:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545866.769096:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789545866.769098:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789545866.769832:0:14457:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789545866.769847:0:14457:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789545866.769889:0:14457:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789545866.769895:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789545866.876972:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545866.946429:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545866.946504:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545866.946693:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545866.958908:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438217472 00000100:00100000:1.0:1789545866.958928:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438217472 00000100:00100000:0.0:1789545866.959302:0:15113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438217728 00000100:00100000:0.0:1789545866.959309:0:15113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438217728 00000100:00100000:3.0:1789545866.959411:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438217600 00000100:00100000:3.0:1789545866.959417:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438217600 00000100:00100000:3.0:1789545866.959453:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 0 00000100:00100000:3.0:1789545866.959463:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+9:2361:x1876474438217472:12345-192.168.201.16@tcp:4:dd.0 00002000:00010000:3.0:1789545866.959520:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aaa4d89, atime: 0x6aaa4d88, ctime: 0x6aaa4d89, blocks: 0x1 00010000:00010000:3.0:1789545866.959530:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ab18f51/0x64919c0f856c1c96 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.959547:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1789545866.959551:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789545866.959558:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ab18f51/0x64919c0f856c1c96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789545866.959572:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ab18f51/0x64919c0f856c1c96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789545867.095322:0:15115:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1789545867.095334:0:15115:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1789545865 -> 1789545867 00002000:00010000:1.0:1789545867.095348:0:15115:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:1.0:1789545867.095387:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ab18f51/0x64919c0f856c1c96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.095402:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ab18f51/0x64919c0f856c1c96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.095412:0:15115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ab18f51/0x64919c0f856c1c96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.095420:0:15115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bee11b600 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:1.0:1789545867.095425:0:15115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ab18f51/0x64919c0f856c1c96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.095435:0:15115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ab18f51/0x64919c0f856c1c96 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.095458:0:15115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ab18f51/0x64919c0f856c1c96 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.095467:0:15115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ab18f51/0x64919c0f856c1c96 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545867.095617:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+11:2361:x1876474438217472:12345-192.168.201.16@tcp:4:dd.0 Request processed in 136147us (149192us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1789545867.095629:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 0 00000100:00100000:1.0:1789545867.095669:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1 00000100:00100000:1.0:1789545867.095682:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+10:2360:x1876474438217728:12345-192.168.201.16@tcp:4:dd.0 00002000:00010000:1.0:1789545867.095729:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6aaa4d8b, atime: 0x6aaa4d88, ctime: 0x0, blocks: 0x807 00010000:00010000:1.0:1789545867.095737:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c1c9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.095750:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=481s v=(0 0) 00010000:00010000:1.0:1789545867.095755:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789545867.095762:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c1c9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.095775:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c1c9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789545867.096072:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:2.0:1789545867.096092:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:0.0:1789545867.195070:0:15115:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 4103 00010000:00010000:0.0:1789545867.195104:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c1c9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545867.195122:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c1c9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545867.195134:0:15115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c1c9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545867.195144:0:15115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1200 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:0.0:1789545867.195150:0:15115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c1c9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545867.195161:0:15115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c1c9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545867.195187:0:15115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c1c9d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545867.195196:0:15115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da245593/0x64919c0f856c1c9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545867.195428:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+8:2360:x1876474438217728:12345-192.168.201.16@tcp:4:dd.0 Request processed in 99743us (248915us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1789545867.195441:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1 00000100:00100000:0.0:1789545867.195490:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2 00000100:00100000:0.0:1789545867.195508:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+7:2360:x1876474438217600:12345-192.168.201.16@tcp:4:dd.0 00002000:00010000:0.0:1789545867.195566:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6aaa4d8b, atime: 0x6aaa4d88, ctime: 0x0, blocks: 0x1007 00010000:00010000:0.0:1789545867.195575:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9565241/0x64919c0f856c1ca4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545867.195589:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=481s v=(0 0) 00010000:00010000:0.0:1789545867.195594:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789545867.195601:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9565241/0x64919c0f856c1ca4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789545867.195739:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00010000:00010000:0.0:1789545867.196018:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9565241/0x64919c0f856c1ca4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789545867.328621:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:0.0:1789545867.328712:0:15115:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:0.0:1789545867.328718:0:15115:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:0.0:1789545867.328737:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9565241/0x64919c0f856c1ca4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545867.328754:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9565241/0x64919c0f856c1ca4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545867.328789:0:15115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9565241/0x64919c0f856c1ca4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545867.328797:0:15115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994be4eb6e00 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:0.0:1789545867.328803:0:15115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9565241/0x64919c0f856c1ca4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545867.328824:0:15115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9565241/0x64919c0f856c1ca4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545867.328852:0:15115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9565241/0x64919c0f856c1ca4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545867.328861:0:15115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9565241/0x64919c0f856c1ca4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545867.328982:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+5:2360:x1876474438217600:12345-192.168.201.16@tcp:4:dd.0 Request processed in 133477us (382284us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789545867.328994:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2 00000100:00100000:0.0:1789545867.343063:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1789545867.344497:0:15113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438217856 00000100:00100000:1.0:1789545867.344520:0:15113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438217856 00000100:00100000:1.0:1789545867.344654:0:15113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3 00000100:00100000:1.0:1789545867.344668:0:15113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+5:2359:x1876474438217856:12345-192.168.201.16@tcp:4:dd.0 00002000:00010000:1.0:1789545867.344742:0:15113:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6aaa4d8b, atime: 0x6aaa4d88, ctime: 0x0, blocks: 0x1807 00010000:00010000:1.0:1789545867.344754:0:15113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c118d3c/0x64919c0f856c1cab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.344801:0:15113:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=481s v=(0 0) 00010000:00010000:1.0:1789545867.344807:0:15113:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789545867.344827:0:15113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c118d3c/0x64919c0f856c1cab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.344846:0:15113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c118d3c/0x64919c0f856c1cab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789545867.358219:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545867.358440:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1789545867.358469:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545867.358751:0:15114:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1789545867.358764:0:15114:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1789545867.359878:0:15115:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789545867.359897:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438217984 00000100:00100000:1.0:1789545867.359911:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438217984 00000100:00100000:1.0:1789545867.359990:0:15115:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789545867.359998:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438218112 00000100:00100000:1.0:1789545867.360001:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438218112 00000100:00100000:1.0:1789545867.360015:0:15115:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789545867.360020:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438218240 00000100:00100000:1.0:1789545867.360023:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438218240 00000100:00100000:2.0:1789545867.360847:0:16653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 4 00000100:00100000:2.0:1789545867.360865:0:16653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84de17c6-8992-45bc-9c05-8b5bb276e0bb+9:2359:x1876474438217984:12345-192.168.201.16@tcp:4:dd.0 00010000:00010000:2.0:1789545867.360921:0:16653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000340bedfa/0x64919c0f856c1cb2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545867.360946:0:16653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545867.360951:0:16653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789545867.360960:0:16653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000340bedfa/0x64919c0f856c1cb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789545867.360977:0:16653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000340bedfa/0x64919c0f856c1cb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545867.364806:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545867.364916:0:15115:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1789545867.364930:0:15115:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1789545867.371134:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438218368 00000100:00100000:3.0:1789545867.371155:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438218368 00000100:00100000:1.0:1789545867.371997:0:16654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 5 00000100:00100000:1.0:1789545867.372015:0:16654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84de17c6-8992-45bc-9c05-8b5bb276e0bb+11:2358:x1876474438218112:12345-192.168.201.16@tcp:4:dd.0 00010000:00010000:1.0:1789545867.372063:0:16654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000392cd61/0x64919c0f856c1cb9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.372085:0:16654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789545867.372090:0:16654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789545867.372098:0:16654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000392cd61/0x64919c0f856c1cb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.372115:0:16654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000392cd61/0x64919c0f856c1cb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789545867.522599:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:1.0:1789545867.535035:0:15113:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:1.0:1789545867.535048:0:15113:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1789545867 00002000:00010000:1.0:1789545867.535051:0:15113:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:1.0:1789545867.535070:0:15113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c118d3c/0x64919c0f856c1cab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.535085:0:15113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c118d3c/0x64919c0f856c1cab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.535095:0:15113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c118d3c/0x64919c0f856c1cab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.535103:0:15113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1600 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:1.0:1789545867.535108:0:15113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c118d3c/0x64919c0f856c1cab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.535118:0:15113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c118d3c/0x64919c0f856c1cab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.535143:0:15113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c118d3c/0x64919c0f856c1cab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.535152:0:15113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c118d3c/0x64919c0f856c1cab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545867.535315:0:15113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+15:2359:x1876474438217856:12345-192.168.201.16@tcp:4:dd.0 Request processed in 190643us (192259us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1789545867.535326:0:15113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3 00000100:00100000:1.0:1789545867.537567:0:15113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 6 00000100:00100000:1.0:1789545867.537591:0:15113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be5193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+14:2359:x1876474438218240:12345-192.168.201.16@tcp:4:dd.0 00010000:00010000:1.0:1789545867.537823:0:15113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7071d9c/0x64919c0f856c1cc0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.537841:0:15113:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789545867.537846:0:15113:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789545867.537853:0:15113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7071d9c/0x64919c0f856c1cc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.537868:0:15113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7071d9c/0x64919c0f856c1cc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789545867.610502:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:1.0:1789545867.613864:0:16653:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:1.0:1789545867.613878:0:16653:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 14343 00010000:00010000:1.0:1789545867.613899:0:16653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000340bedfa/0x64919c0f856c1cb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.613917:0:16653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000340bedfa/0x64919c0f856c1cb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.613928:0:16653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000340bedfa/0x64919c0f856c1cb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.613956:0:16653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994ac2be8000 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:1.0:1789545867.613962:0:16653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000340bedfa/0x64919c0f856c1cb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.613972:0:16653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000340bedfa/0x64919c0f856c1cb2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.613998:0:16653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000340bedfa/0x64919c0f856c1cb2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.614007:0:16653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000340bedfa/0x64919c0f856c1cb2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545867.614143:0:16653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84de17c6-8992-45bc-9c05-8b5bb276e0bb+12:2359:x1876474438217984:12345-192.168.201.16@tcp:4:dd.0 Request processed in 253276us (255930us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1789545867.614155:0:16653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 4 00000100:00100000:1.0:1789545867.614201:0:16653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7 00000100:00100000:1.0:1789545867.614216:0:16653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84de17c6-8992-45bc-9c05-8b5bb276e0bb+11:2358:x1876474438218368:12345-192.168.201.16@tcp:4:dd.0 00010000:00010000:1.0:1789545867.614257:0:16653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c118d3c/0x64919c0f856c1cc7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.614271:0:16653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789545867.614276:0:16653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789545867.614284:0:16653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c118d3c/0x64919c0f856c1cc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.614324:0:16653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c118d3c/0x64919c0f856c1cc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545867.618973:0:16654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000392cd61/0x64919c0f856c1cb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545867.619000:0:16654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000392cd61/0x64919c0f856c1cb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545867.619022:0:16654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000392cd61/0x64919c0f856c1cb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545867.619030:0:16654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1c00 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:0.0:1789545867.619036:0:16654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000392cd61/0x64919c0f856c1cb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545867.619047:0:16654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000392cd61/0x64919c0f856c1cb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545867.619076:0:16654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000392cd61/0x64919c0f856c1cb9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789545867.619085:0:16654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000392cd61/0x64919c0f856c1cb9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789545867.619206:0:16654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84de17c6-8992-45bc-9c05-8b5bb276e0bb+11:2358:x1876474438218112:12345-192.168.201.16@tcp:4:dd.0 Request processed in 247191us (260760us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1789545867.619218:0:16654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 5 00000001:00080000:0.0:1789545867.658135:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:1.0:1789545867.661426:0:15113:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:1.0:1789545867.661441:0:15113:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1789545867.661461:0:15113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7071d9c/0x64919c0f856c1cc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.661478:0:15113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7071d9c/0x64919c0f856c1cc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.661487:0:15113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7071d9c/0x64919c0f856c1cc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.661496:0:15113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1e00 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:1.0:1789545867.661502:0:15113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7071d9c/0x64919c0f856c1cc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.661513:0:15113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7071d9c/0x64919c0f856c1cc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.661539:0:15113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7071d9c/0x64919c0f856c1cc0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.661548:0:15113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7071d9c/0x64919c0f856c1cc0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545867.661698:0:15113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be5193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+9:2359:x1876474438218240:12345-192.168.201.16@tcp:4:dd.0 Request processed in 124110us (303219us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1789545867.661710:0:15113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 6 00010000:00010000:1.0:1789545867.711755:0:16653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c118d3c/0x64919c0f856c1cc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.711784:0:16653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c118d3c/0x64919c0f856c1cc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.711795:0:16653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c118d3c/0x64919c0f856c1cc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.711960:0:16653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994bc49d1600 already unused, calling callback (ffffffffc16d0a20) 00010000:00010000:1.0:1789545867.711970:0:16653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c118d3c/0x64919c0f856c1cc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.711983:0:16653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c118d3c/0x64919c0f856c1cc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.712013:0:16653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c118d3c/0x64919c0f856c1cc7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789545867.712023:0:16653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c118d3c/0x64919c0f856c1cc7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789545867.712246:0:16653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84de17c6-8992-45bc-9c05-8b5bb276e0bb+7:2358:x1876474438218368:12345-192.168.201.16@tcp:4:dd.0 Request processed in 98030us (347450us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1789545867.712259:0:16653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7 00000001:00080000:3.0:1789545867.712401:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:3.0:1789545867.900763:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789545868.726274:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545868.726318:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545868.726348:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545868.726414:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545868.726438:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545868.726461:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545868.726487:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1789545868.726515:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438219008 00000100:00100000:2.0:1789545868.726527:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438219008 00000100:00100000:2.0:1789545868.726601:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438218624 00000100:00100000:2.0:1789545868.726605:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438218624 00000100:00100000:2.0:1789545868.726649:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 30 00000100:00100000:2.0:1789545868.726659:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+6:2359:x1876474438219008:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545868.726745:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+6:2359:x1876474438219008:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 88us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545868.726754:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 30 00000100:00100000:2.0:1789545868.726774:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 31 00000100:00100000:2.0:1789545868.726780:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+20:2359:x1876474438218624:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545868.726822:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84de17c6-8992-45bc-9c05-8b5bb276e0bb+20:2359:x1876474438218624:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 42us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545868.726828:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 31 00000100:00100000:2.0:1789545868.726846:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438218752 00000100:00100000:2.0:1789545868.726849:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438218752 00000100:00100000:2.0:1789545868.726867:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438219264 00000100:00100000:2.0:1789545868.726869:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438219264 00000100:00100000:2.0:1789545868.726881:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438218880 00000100:00100000:2.0:1789545868.726883:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438218880 00000100:00100000:2.0:1789545868.726893:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438219136 00000100:00100000:2.0:1789545868.726896:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438219136 00000100:00100000:2.0:1789545868.726909:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 19 00000100:00100000:2.0:1789545868.726915:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+5:2359:x1876474438218752:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545868.726940:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+5:2359:x1876474438218752:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 25us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545868.726946:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 19 00000100:00100000:2.0:1789545868.726958:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 20 00000100:00100000:2.0:1789545868.726964:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+5:2359:x1876474438219264:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545868.726985:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+5:2359:x1876474438219264:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 22us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545868.727010:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 20 00000100:00100000:2.0:1789545868.727023:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 21 00000100:00100000:2.0:1789545868.727029:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfb43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+5:2359:x1876474438218880:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545868.727054:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfb43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84de17c6-8992-45bc-9c05-8b5bb276e0bb+5:2359:x1876474438218880:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 25us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545868.727060:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 21 00000100:00100000:2.0:1789545868.727071:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 22 00000100:00100000:2.0:1789545868.727077:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be54a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+5:2359:x1876474438219136:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1789545868.727098:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be54a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:daf4bf8f-5385-4ff6-ae15-d2b9e125b22e+5:2359:x1876474438219136:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 22us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789545868.727104:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 22 00000100:00080000:2.0:1789545868.727130:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789545868.727134:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789545868.727137:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789545868.733105:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474438218496 00000100:00100000:3.0:1789545868.733123:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474438218496 00000100:00100000:3.0:1789545868.733259:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 123 00000100:00100000:3.0:1789545868.733270:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be41ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf44d924-2261-46de-bbbd-7daed3b9d29d+13:2359:x1876474438218496:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:3.0:1789545868.733391:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be41ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf44d924-2261-46de-bbbd-7daed3b9d29d+13:2359:x1876474438218496:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 123us (7130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545868.733400:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 123 00010000:00010000:0.0:1789545868.924991:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545869.389120:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454977536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789545869.389201:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789545869.390545:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454977536 00000100:00100000:3.0:1789545869.390560:0:15111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454977536 00000100:00100000:3.0:1789545869.390641:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789545869.390652:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be479b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454977536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789545869.390695:0:15111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789545869.392045:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789545869.398619:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be479b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876474454977536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7960us (9409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545869.398634:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789545869.405236:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876474454977536:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1789545869.450319:0:16691:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1789545869.949140:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789545870.397053:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454977792:0@lo:400:kworker.0 00000100:00100000:1.0:1789545870.397137:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545870.397201:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf5dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454978304:0@lo:400:kworker.0 00000100:00100000:1.0:1789545870.397228:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545870.397255:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789545870.397261:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6de5819a-62ff-4f85-af03-c287b54b27c1:3312:1876474454977664:0@lo:400:kworker.0 00000100:00100000:1.0:1789545870.397290:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545870.397313:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf5d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876474454978176:0@lo:400:kworker.0 00000100:00100000:1.0:1789545870.397390:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545870.397419:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454977920:0@lo:400:kworker.0 00000100:00100000:1.0:1789545870.397446:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545870.397464:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789545870.397470:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994bdf5daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454978048:0@lo:400:kworker.0 00000100:00100000:1.0:1789545870.397490:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789545870.397519:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454977792 00000100:00100000:1.0:1789545870.397526:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454977792 00000100:00100000:0.0:1789545870.398478:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454978304 00000100:00100000:0.0:1789545870.398485:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454978304 00000100:00100000:0.0:1789545870.398524:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454978176 00000100:00100000:0.0:1789545870.398535:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454978176 00000100:00100000:0.0:1789545870.398551:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454978048 00000100:00100000:0.0:1789545870.398553:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454978048 00000100:00100000:0.0:1789545870.398577:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789545870.398586:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf5dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454978304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545870.398652:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf5dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876474454978304:12345-0@lo:400:kworker.0 Request processed in 67us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545870.398659:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789545870.398674:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789545870.398679:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf5da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876474454978176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545870.398700:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf5da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876474454978176:12345-0@lo:400:kworker.0 Request processed in 22us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545870.398706:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789545870.398714:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789545870.398719:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf5db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454978048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789545870.398738:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf5db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876474454978048:12345-0@lo:400:kworker.0 Request processed in 20us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545870.398743:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789545870.398777:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff994be4edd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454978432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789545870.398807:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789545870.398842:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf5daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876474454978048:0@lo:400:kworker.0 00000100:00100000:0.0:1789545870.398869:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454978432 00000100:00100000:0.0:1789545870.398872:0:15111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454978432 00000100:00100000:0.0:1789545870.398900:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789545870.398907:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdfc51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454978432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789545870.398935:0:15111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1789545870.398974:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdfc51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454978432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789545870.398980:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789545870.399003:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1789545870.399008:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff994be4b3f100, transno 8589934595 00000004:00080000:0.0:1789545870.399018:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1789545870.399038:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4edd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454978432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789545870.399591:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454977920 00000100:00100000:3.0:1789545870.399597:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454977920 00000100:00100000:3.0:1789545870.399630:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789545870.399638:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454977792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545870.399677:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876474454977792:12345-0@lo:400:kworker.0 Request processed in 40us (2540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545870.399682:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789545870.399693:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789545870.399698:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994bdf5db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454977920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545870.399722:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994bdf5db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876474454977920:12345-0@lo:400:kworker.0 Request processed in 23us (2275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545870.399733:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789545870.399769:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876474454977664 00000100:00100000:3.0:1789545870.399773:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876474454977664 00000100:00100000:3.0:1789545870.399795:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789545870.399801:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff994be41ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+19:3312:x1876474454977664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789545870.399828:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff994be41ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6de5819a-62ff-4f85-af03-c287b54b27c1+19:3312:x1876474454977664:12345-0@lo:400:kworker.0 Request processed in 28us (2538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789545870.399834:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:2.0:1789545870.400084:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789545870.400089:0:14419:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789545870.402855:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6de5819a-62ff-4f85-af03-c287b54b27c1:3312:1876474454977664:0@lo:400:kworker.0 00000100:00100000:1.0:1789545870.402900:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf5d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876474454978176:0@lo:400:kworker.0 00000100:00100000:1.0:1789545870.402913:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876474454977792:0@lo:400:kworker.0 00000100:00100000:1.0:1789545870.402925:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994bdf5dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876474454978304:0@lo:400:kworker.0 00000100:00100000:1.0:1789545870.402999:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff994be4799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876474454977920:0@lo:400:kworker.0 00010000:00010000:1.0:1789545870.972561:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29491 lines, 29491 kept, 0 dropped, 0 bad.